Douglas Thain

ORCID

Publication Activity (10 Years)

Years Active: 2000-2024
Publications (10 Years): 48

Top Venues

Publications

Thanh Son Phung, Douglas Thain
Adaptive Task-Oriented Resource Allocation for Large Dynamic Workflows on Opportunistic Resources. IPDPS (2024)
Barry Sly-Delgado, Thanh Son Phung, Colin Thomas, David Simonetti, Andrew Hennessee, Ben Tovar, Douglas Thain
TaskVine: Managing In-Cluster Storage for High-Throughput Data Intensive Workflows. SC Workshops (2023)
Tim Shaffer, Thanh Son Phung, Kyle Chard, Douglas Thain
Landlord: Coordinating Dynamic Software Environments to Reduce Container Sprawl. IEEE Trans. Parallel Distributed Syst. 34 (5) (2023)
Sandra Gesing, Ewa Deelman, Michael D. Hildreth, Ramandeep Makhija, Mary Ann McDowell, Natalie K. Meyers, Douglas Thain
VisDict: Improving Communication Via a Visual Dictionary in a Science Gateway. Comput. Sci. Eng. 25 (2) (2023)
David Simonetti, Ben Tovar, Douglas Thain
Mixed Modality Workflows in TaskVine. HPDC (2023)
Thanh Son Phung, Ben Clifford, Kyle Chard, Douglas Thain
Maximizing Data Utility for HPC Python Workflow Execution. SC Workshops (2023)
Ben Lyons, Douglas Thain
Robust Meta-Workflow Management with Mufasa. e-Science (2022)
Barry Sly-Delgado, Nick Locascio, David Simonetti, Brett Wiseman, Ben Tovar, Douglas Thain
PONCHO: Dynamic Package Synthesis for Distributed and Serverless Python Applications. HiPS@HPDC (2022)
Ben Tovar, Ben Lyons, Kelci Mohrman, Barry Sly-Delgado, Kevin Lannon, Douglas Thain
Dynamic Task Shaping for High Throughput Data Analysis Applications in High Energy Physics. IPDPS (2022)
Tim Shaffer, Kyle Chard, Douglas Thain
An Empirical Study of Package Dependencies and Lifetimes in Binder Python Containers. e-Science (2021)
Thanh Son Phung, Logan T. Ward, Kyle Chard, Douglas Thain
Not All Tasks Are Created Equal: Adaptive Resource Allocation for Heterogeneous Tasks in Dynamic Workflows. WORKS (2021)
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M. Badia, Bartosz Balis, Tainã Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Daniel Garijo, Carole A. Goble, Dorran Howell, Shantenu Jha, Daniel S. Katz, Daniel Laney, Ulf Leser, Maciej Malawski, Kshitij Mehta, Loïc Pottier, Jonathan Ozik, J. Luc Peterson, Lavanya Ramakrishnan, Stian Soiland-Reyes, Douglas Thain, Matthew Wolf
A Community Roadmap for Scientific Workflows Research and Development. WORKS (2021)
Henri Casanova, Ewa Deelman, Sandra Gesing, Michael D. Hildreth, Stephen Hudson, William Koch, Jeffrey Larson, Mary Ann McDowell, Natalie Meyers, John-Luke Navarro, George Papadimitriou, Ryan Tanaka, Ian J. Taylor, Douglas Thain, Stefan M. Wild, Rosa Filgueira, Rafael Ferreira da Silva
Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education. WORKS (2021)
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Dan Laney, Dong H. Ahn, Shantenu Jha, Carole A. Goble, Lavanya Ramakrishnan, J. Luc Peterson, Bjoern Enders, Douglas Thain, Ilkay Altintas, Yadu N. Babuji, Rosa M. Badia, Vivien Bonazzi, Tainã Coleman, Michael R. Crusoe, Ewa Deelman, Frank Di Natale, Paolo Di Tommaso, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Alex Ganose, Björn A. Grüning, Daniel S. Katz, Olga Kuchar, Ana Kupresanin, Bertram Ludäscher, Ketan Maheshwari, Marta Mattoso, Kshitij Mehta, Todd S. Munson, Jonathan Ozik, Tom Peterka, Loic Pottier, Tim Randles, Stian Soiland-Reyes, Benjamín Tovar, Matteo Turilli, Thomas D. Uram, Karan Vahi, Michael Wilde, Matthew Wolf, Justin M. Wozniak
Workflows Community Summit: Bringing the Scientific Workflows Community Together. CoRR (2021)
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Tainã Coleman, Dan Laney, Dong H. Ahn, Shantenu Jha, Dorran Howell, Stian Soiland-Reyes, Ilkay Altintas, Douglas Thain, Rosa Filgueira, Yadu N. Babuji, Rosa M. Badia, Bartosz Balis, Silvina Caíno-Lores, Scott Callaghan, Frederik Coppens, Michael R. Crusoe, Kaushik De, Frank Di Natale, Tu Mai Anh Do, Bjoern Enders, Thomas Fahringer, Anne Fouilloux, Grigori Fursin, Alban Gaignard, Alex Ganose, Daniel Garijo, Sandra Gesing, Carole A. Goble, Adil Hasan, Sebastiaan Huber, Daniel S. Katz, Ulf Leser, Douglas Lowe, Bertram Ludäscher, Ketan Maheshwari, Maciej Malawski, Rajiv Mayani, Kshitij Mehta, André Merzky, Todd S. Munson, Jonathan Ozik, Loïc Pottier, Sashko Ristov, Mehdi Roozmeh, Renan Souza, Frédéric Suter, Benjamín Tovar, Matteo Turilli, Karan Vahi, Alvaro Vidal-Torreira, Wendy R. Whitcup, Michael Wilde, Alan Williams, Matthew Wolf, Justin M. Wozniak
Workflows Community Summit: Advancing the State-of-the-art of Scientific Workflows Management Systems Research and Development. CoRR (2021)
Tim Shaffer, Zhuozhao Li, Ben Tovar, Yadu N. Babuji, T. J. Dasso, Zoe Surma, Kyle Chard, Ian T. Foster, Douglas Thain
Lightweight Function Monitors for Fine-Grained Management in Large Scale Python Applications. IPDPS (2021)
Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M. Badia, Bartosz Balis, Tainã Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira, Grigori Fursin, Daniel Garijo, Carole A. Goble, Dorran Howell, Shantenu Jha, Daniel S. Katz, Daniel Laney, Ulf Leser, Maciej Malawski, Kshitij Mehta, Loïc Pottier, Jonathan Ozik, J. Luc Peterson, Lavanya Ramakrishnan, Stian Soiland-Reyes, Douglas Thain, Matthew Wolf
A Community Roadmap for Scientific Workflows Research and Development. CoRR (2021)
Nathaniel Kremer-Herman, Douglas Thain
Log Discovery for Troubleshooting Open Distributed Systems with TLQ. PEARC (2020)
Tim Shaffer, Nicholas L. Hazekamp, Jakob Blomer, Douglas Thain
Solving the Container Explosion Problem for Distributed High Throughput Computing. IPDPS (2020)
Chao Zheng, Nathaniel Kremer-Herman, Tim Shaffer, Douglas Thain
Autoscaling High-Throughput Workloads on Container Orchestrators. CLUSTER (2020)
Nicholas L. Hazekamp, Benjamín Tovar, Douglas Thain
Dynamic Sizing of Continuously Divisible Jobs for Heterogeneous Resources. eScience (2019)
Tim Shaffer, Nathaniel Kremer-Herman, Douglas Thain
Flexible Partitioning of Scientific Workflows Using the JX Workflow Language. PEARC (2019)
Benjamín Tovar, Nicholas L. Hazekamp, Nathaniel Kremer-Herman, Douglas Thain
Automatic Dependency Management for Scientific Applications on Clusters. IC2E (2018)
Kyle M. D. Sweeney, Douglas Thain
Early Experience Using Amazon Batch for Scientific Workflows. ScienceCloud@HPDC (2018)
Nathaniel Kremer-Herman, Benjamín Tovar, Douglas Thain
A lightweight model for right-sizing master-worker applications. SC (2018)
Nicholas L. Hazekamp, Upendra Kumar Devisetty, Nirav C. Merchant, Douglas Thain
MAKER as a Service: Moving HPC Applications to Jetstream Cloud. IC2E (2018)
Jeffery Kinnison, Nathaniel Kremer-Herman, Douglas Thain, Walter J. Scheirer
SHADHO: Massively Scalable Hardware-Aware Distributed Hyperparameter Optimization. WACV (2018)
Kyle M. D. Sweeney, Douglas Thain
Efficient Integration of Containers into Scientific Workflows. ScienceCloud@HPDC (2018)
Nicholas L. Hazekamp, Douglas Thain
An Algebra for Robust Workflow Transformations. eScience (2018)
Peter Ivie, Douglas Thain
Reproducibility in Scientific Computing. ACM Comput. Surv. 51 (3) (2018)
Lincoln Bryant, Jeremy Van, Benedikt Riedel, Robert W. Gardner, Jose Caballero Bejar, John Hover, Ben Tovar, Kenyi Hurtado, Douglas Thain
VC3: A Virtual Cluster Service for Community Computation. PEARC (2018)
Chao Zheng, Lukas Rupprecht, Vasily Tarasov, Douglas Thain, Mohamed Mohamed, Dimitrios Skourtis, Amit Warke, Dean Hildebrand
Wharf: Sharing Docker Images in a Distributed File System. SoCC (2018)
Nicholas L. Hazekamp, Nathaniel Kremer-Herman, Benjamín Tovar, Haiyan Meng, Olivia Choudhury, Scott J. Emrich, Douglas Thain
Combining Static and Dynamic Storage Management for Data Intensive Scientific Workflows. IEEE Trans. Parallel Distributed Syst. 29 (2) (2018)
Benjamín Tovar, Rafael Ferreira da Silva, Gideon Juve, Ewa Deelman, William E. Allcock, Douglas Thain, Miron Livny
A Job Sizing Strategy for High-Throughput Scientific Workflows. IEEE Trans. Parallel Distributed Syst. 29 (2) (2018)
Tim Shaffer, Kyle M. D. Sweeney, Nathaniel Kremer-Herman, Douglas Thain
A First Look at the JX Workflow Language. eScience (2018)
Haiyan Meng, Douglas Thain
Facilitating the Reproducibility of Scientific Workflows with Execution Environment Specifications. ICCS (2017)
Daniel Yue Zhang, Chao Zheng, Dong Wang, Douglas Thain, Xin Mu, Greg Madey, Chao Huang
Towards Scalable and Dynamic Social Sensing Using A Distributed Computing Framework. ICDCS (2017)
Patrick Donnelly, Douglas Thain
Balancing push and pull in Confuga, an active storage cluster file system for scientific workflows. Concurr. Comput. Pract. Exp. 29 (4) (2017)
Ketan Maheshwari, Daniel S. Katz, Sílvia Delgado Olabarriaga, Justin M. Wozniak, Douglas Thain
Report on the first workshop on negative and null results in eScience. Concurr. Comput. Pract. Exp. 29 (2) (2017)
Chao Zheng, Ben Tovar, Douglas Thain
Deploying High Throughput Scientific Workflows on Container Schedulers with Makeflow and Mesos. CCGrid (2017)
Dinesh Rajan, Douglas Thain
Designing Self-Tuning Split-Map-Merge Applications for High Cost-Efficiency in the Cloud. IEEE Trans. Cloud Comput. 5 (2) (2017)
Jeff Kinnison, Nathaniel Kremer-Herman, Douglas Thain, Walter J. Scheirer
SHADHO: Massively Scalable Hardware-Aware Distributed Hyperparameter Optimization. CoRR (2017)
Tim Shaffer, Douglas Thain
Taming metadata storms in parallel filesystems with metaFS. PDSW-DISCS@SC (2017)
Haipeng Cai, Douglas Thain
DistIA: a cost-effective dynamic impact analysis for distributed programs. ASE (2016)
Haiyan Meng, Douglas Thain, Alexander Vyushkov, Matthias Wolf, Anna Woodard
Conducting reproducible research with Umbrella: Tracking, creating, and preserving execution environments. eScience (2016)
Haipeng Cai, Douglas Thain
DISTEA: Efficient Dynamic Impact Analysis for Distributed Systems. CoRR (2016)
Haipeng Cai, Raúl A. Santelices, Douglas Thain
DiaPro: Unifying Dynamic Impact Analyses for Improved and Variable Cost-Effectiveness. ACM Trans. Softw. Eng. Methodol. 25 (2) (2016)
Peter Ivie, Douglas Thain
PRUNE: A preserving run environment for reproducible scientific computing. eScience (2016)
Douglas Thain, Peter Ivie, Haiyan Meng
Techniques for Preserving Scientific Software Executions: Preserve the Mess or Encourage Cleanliness? iPRES (2015)
Nicholas L. Hazekamp, Joseph Sarro, Olivia Choudhury, Sandra Gesing, Scott J. Emrich, Douglas Thain
Scaling Up Bioinformatics Workflows with Dynamic Job Expansion: A Case Study Using Galaxy and Makeflow. e-Science (2015)
Haiyan Meng, Douglas Thain
Umbrella: A Portable Environment Creator for Reproducible Computing on Clusters, Clouds, and Grids. VTDC@HPDC (2015)
Peter Sempolinski, Douglas Thain, Zhigang Wei, Ahsan Kareem
Adapting Collaborative Software Development Techniques to Structural Engineering. Comput. Sci. Eng. 17 (5) (2015)
Charles Zheng, Douglas Thain
Integrating Containers into Workflows: A Case Study Using Makeflow, Work Queue, and Docker. VTDC@HPDC (2015)
Haiyan Meng, Rupa Kommineni, Quan Pham, Robert W. Gardner, Tanu Malik, Douglas Thain
An invariant framework for conducting reproducible computational science. J. Comput. Sci. 9 (2015)
Olivia Choudhury, Nicholas L. Hazekamp, Douglas Thain, Scott J. Emrich
Accelerating Comparative Genomics Work ows in a Distributed Environment with Optimized Data Partitioning and Workflow Fusion. Scalable Comput. Pract. Exp. 16 (1) (2015)
Gideon Juve, Benjamín Tovar, Rafael Ferreira da Silva, Dariusz Król, Douglas Thain, Ewa Deelman, William E. Allcock, Miron Livny
Practical Resource Monitoring for Robust High Throughput Computing. CLUSTER (2015)
Jakob Blomer, Predrag Buncic, René Meusel, Gerardo Ganis, Igor Sfiligoi, Douglas Thain
The Evolution of Global Scale Filesystems for Scientific Software Distribution. Comput. Sci. Eng. 17 (6) (2015)
Patrick Donnelly, Nicholas L. Hazekamp, Douglas Thain
Confuga: Scalable Data Intensive Computing for POSIX Workflows. CCGRID (2015)
Anna Woodard, Matthias Wolf, Charles Mueller, Nil Valls, Ben Tovar, Patrick Donnelly, Peter Ivie, Kenyi Hurtado Anampa, Paul R. Brenner, Douglas Thain, Kevin Lannon, Michael D. Hildreth
Scaling Data Intensive Physics Applications to 10k Cores on Non-dedicated Clusters with Lobster. CLUSTER (2015)
Olivia Choudhury, Dinesh Rajan, Nicholas L. Hazekamp, Sandra Gesing, Douglas Thain, Scott J. Emrich
Balancing Thread-Level and Task-Level Parallelism for Data-Intensive Workloads on Clusters and Clouds. CLUSTER (2015)
An Huynh, Douglas Thain, Miquel Pericàs, Kenjiro Taura
DAGViz: a DAG visualization tool for analyzing task-parallel program traces. VPA@SC (2015)
Matthew Staffelbach, Peter Sempolinski, David Hachen, Ahsan Kareem, Tracy Kijewski-Correa, Douglas Thain, Daniel Wei, Greg Madey
Lessons Learned from an Experiment in Crowdsourcing Complex Citizen Engineering Tasks with Amazon Mechanical Turk. CoRR (2014)
Andrew Thrasher, Zachary Musgrave, Brian Kachmarck, Douglas Thain, Scott J. Emrich
Scaling up genome annotation using MAKER and work queue. Int. J. Bioinform. Res. Appl. 10 (4/5) (2014)
Dillon Skeehan, Paul R. Brenner, Ben Tovar, Douglas Thain, Nil Valls, Anna Woodard, Matthias Wolf, T. Pearson, S. Lynch, Kevin Lannon
Opportunistic High Energy Physics Computing in User Space with Parrot. CCGRID (2014)
Badi Abdul-Wahid, Haoyun Feng, Dinesh Rajan, Ronan Costaouec, Eric Darve, Douglas Thain, Jesús A. Izaguirre
AWE-WQ: Fast-Forwarding Molecular Dynamics Using the Accelerated Weighted Ensemble. J. Chem. Inf. Model. 54 (10) (2014)
Olivia Choudhury, Nicholas L. Hazekamp, Douglas Thain, Scott J. Emrich
Accelerating Comparative Genomics Workflows in a Distributed Environment with Optimized Data Partitioning. CCGRID (2014)
Peter Ivie, Douglas Thain
DeltaDB: A Scalable Database Design for Time-Varying Schema-Free Data. BigData Congress (2014)
Irena Lanc, Peter Bui, Douglas Thain, Scott J. Emrich
Adapting bioinformatics applications for heterogeneous systems: a case study. Concurr. Comput. Pract. Exp. 26 (4) (2014)
Nicholas L. Hazekamp, Olivia Choudhury, Sandra Gesing, Scott J. Emrich, Douglas Thain
Expanding Tasks of Logical Workflows Into Independent Workflows for Improved Scalability. CCGRID (2014)
Casey Robinson, Douglas Thain
Automated packaging of bioinformatics workflows for portability and durability using makeflow. WORKS@SC (2013)
Rafael Ferreira da Silva, Gideon Juve, Ewa Deelman, Tristan Glatard, Frédéric Desprez, Douglas Thain, Benjamín Tovar, Miron Livny
Toward fine-grained online task characteristics estimation in scientific workflows. WORKS@SC (2013)
Patrick Donnelly, Douglas Thain
Design of an active storage cluster file system for DAG workflows. DISCS@SC (2013)
Dinesh Rajan, Andrew Thrasher, Badi Abdul-Wahid, Jesús A. Izaguirre, Scott J. Emrich, Douglas Thain
Case Studies in Designing Elastic Applications. CCGRID (2013)
Michael Albrecht, Dinesh Rajan, Douglas Thain
Making work queue cluster-friendly for data intensive scientific applications. CLUSTER (2013)
Hoang Bui, Peter Bui, Patrick J. Flynn, Douglas Thain
ROARS: a robust object archival system for data intensive scientific computing. Distributed Parallel Databases 30 (5-6) (2012)
Michael Albrecht, Patrick Donnelly, Peter Bui, Douglas Thain
Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids. SWEET@SIGMOD (2012)
Peter Bui, Li Yu, Andrew Thrasher, Rory Carmichael, Irena Lanc, Patrick Donnelly, Douglas Thain
Scripting distributed scientific workflows using Weaver. Concurr. Comput. Pract. Exp. 24 (15) (2012)
Peter Sempolinski, Douglas Thain, Daniel Wei, Ahsan Kareem
A system for management of Computational Fluid Dynamics simulations for civil engineering. eScience (2012)
Andrew Thrasher, Douglas Thain, Scott J. Emrich, Zachary Musgrave
Shifting the bioinformatics computing paradigm: A case study in parallelizing genome annotation using MAKER and Work Queue. ICCABS (2012)
Christopher Moretti, Andrew Thrasher, Li Yu, Michael Olson, Scott J. Emrich, Douglas Thain
A Framework for Scalable Genome Assembly on Clusters, Clouds, and Grids. IEEE Trans. Parallel Distributed Syst. 23 (12) (2012)
Li Yu, Douglas Thain
Resource Management for Elastic Cloud Workflows. CCGRID (2012)
Patrick Donnelly, Douglas Thain
Fine-Grained Access Control in the Chirp Distributed File System. CCGRID (2012)
Badi Abdul-Wahid, Li Yu, Dinesh Rajan, Haoyun Feng, Eric Darve, Douglas Thain, Jesús A. Izaguirre
Folding proteins at 500 ns/hour with Work Queue. eScience (2012)
Rory Carmichael, Patrick Braga-Henebry, Douglas Thain, Scott J. Emrich
Biocompute 2.0: an improved collaborative workspace for data intensive bio-science. Concurr. Comput. Pract. Exp. 23 (17) (2011)
Zhi Zhai, Peter Sempolinski, Douglas Thain, Gregory R. Madey, Daniel Wei, Ahsan Kareem
Expert-Citizen Engineering: "Crowdsourcing" Skilled Citizens. DASC (2011)
Dinesh Rajan, Anthony Canino, Jesús A. Izaguirre, Douglas Thain
Converting a High Performance Application to an Elastic Cloud Application. CloudCom (2011)
Patrick Donnelly, Peter Bui, Douglas Thain
Attaching Cloud Storage to a Campus Grid Using Parrot, Chirp, and Hadoop. CloudCom (2010)
Katarzyna Keahey, Domenico Laforenza, Alexander Reinefeld, Pierluigi Ritrovato, Douglas Thain, Nancy Wilkins-Diehr
Grid, Cluster and Cloud Computing. Euro-Par (1) (2010)
Peter Sempolinski, Douglas Thain
A Comparison and Critique of Eucalyptus, OpenNebula and Nimbus. CloudCom (2010)
Peter Bui, Li Yu, Douglas Thain
Weaver: integrating distributed computing abstractions into scientific workflows using Python. HPDC (2010)
Rory Carmichael, Patrick Braga-Henebry, Douglas Thain, Scott J. Emrich
Biocompute: towards a collaborative workspace for data intensive bio-science. HPDC (2010)
Christopher Moretti, Hoang Bui, Karen Hollingsworth, Brandon Rich, Patrick J. Flynn, Douglas Thain
All-Pairs: An Abstraction for Data-Intensive Computing on Campus Grids. IEEE Trans. Parallel Distributed Syst. 21 (1) (2010)
Hoang Bui, Diane Wright, Clarence Helm, Rachel Witty, Patrick J. Flynn, Douglas Thain
Towards long term data quality in a large scale biometrics experiment. HPDC (2010)
Ioan Raicu, Ian T. Foster, Mike Wilde, Zhao Zhang, Kamil Iskra, Peter H. Beckman, Yong Zhao, Alexander S. Szalay, Alok N. Choudhary, Philip Little, Christopher Moretti, Amitabh Chaudhary, Douglas Thain
Middleware support for many-task computing. Clust. Comput. 13 (3) (2010)
Hoang Bui, Peter Bui, Patrick J. Flynn, Douglas Thain
ROARS: a scalable repository for data intensive scientific computing. HPDC (2010)
Li Yu, Christopher Moretti, Andrew Thrasher, Scott J. Emrich, Kenneth Judd, Douglas Thain
Harnessing parallelism in multicore clusters with the All-Pairs, Wavefront, and Makeflow abstractions. Clust. Comput. 13 (3) (2010)
Kyle B. Wheeler, Douglas Thain
Visualizing massively multithreaded applications with ThreadScope. Concurr. Comput. Pract. Exp. 22 (1) (2010)
Paul R. Brenner, Ryan Jansen, David B. Go, Douglas Thain
Environmentally Opportunistic Computing transforming the data center for economic and environmental sustainability. Green Computing Conference (2010)
Jeffrey Hemmes, Douglas Thain, Christian Poellabauer
Cooperative Localization in GPS-Limited Urban Environments. ADHOCNETS (2009)
Michael Lammie, Paul R. Brenner, Douglas Thain
Scheduling Grid workloads on multicore clusters to minimize energy and maximize performance. GRID (2009)

Douglas Thain.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Douglas Thain