PSEIS,ASeismicProcessingArchitectureBlueprint

Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,11 June 2006,*,PSEIS, A Seismic ProcessingArchitecture Blueprint,RSF/Madagascar School and Workshop:,Reproducible Research in Computational Geophysics,Vancouver 2006,Randall L. Selzler* RSelzler (at) Data-W,Joseph A. Dellinger Joseph.Dellinger (at) BP.com,P,arallel,S,eismic,E,arth,I,maging,S,ystem,Proposed Successor for DDS,Pronounced “P-S,ize,”.,Architecture Blueprint,Review and amend,Guide implementation,Ambitious Goals,Open Source Philosophy,Open Source Seismic Software,What is the Prize?,Technical superiority,Freedom to innovate,Self sufficient,Minimize vendor lock-in,Vibrant community,End-users, developers, maintainers,Enthusiastic participants,Wide acceptance,Amortize costs,Portable skills,Talent pool,Foster collaboration,Technology transfer,This Workshop,Share knowledge,Explore ideas,Foster relations,Essential forReproducibleResearch,PSEIS versus DDS,Fix the Bad,Easier for end-users and developers!,Cleaner Implementation of DDS concepts,Keep the Good,Interoperation,Emulation,Flexible,(research convenience),Efficient,(production processing),Applications,Open source,Portable,Philosophy:,Data handling is fundamental.Get it right and other issues will fall into place.(Get it wrong and the system is doomed to mediocrity.),New Capabilities,Maximize total value,How to Make It “Easier”,Easier for end-user and application developers.,Lower the Goals,Only attempt the simple,Data cube, no headers,Fixed dimension count,Time series centric,Ignore other systems,Serial processing only,Research agenda,Risks,Shifted burden,Fragmented solutions,Duplicate effort,Less easy,overalll,Raise the Effort,Invest in the infrastructure,Consider the big picture!,No magic bullet,Choice,How to Make It “Easier”,Easier for end-user and application developers.,Raise the Effort,Invest in the infrastructure,Organizations and individuals,Open source, peer review,Emphasis on usability,Object Oriented Technology,Rewards,Maximize total value People productivity Interoperation Emulation Software reuse Hardware utilization,Wide acceptance Amortize costs Foster collaboration Technology transfer Portable skills Talent pool,New and Used Applications,PSEISApplication,Generic Write,Generic Read,Disk Tape,Non-PSEIS,Application,Non-PSEIS,Application,Disk Tape,Any PSEISSupported,Format,Non-PSEISApplication,API Emulation,Generic I/O,PSEISApplication,Generic I/O,API Emulation,Foreign,Format,Foreign Library,Leverage Existing Software,Via format and API emulation,“Missing Link” in system evolution,DDS, USP, SU, RSF, ,New,Interoperation,Emulation,New Capabilities,Integrated Parallel Programming,Easier than MPI,Distributed memory,Efficient and scalable,Dictionary Tree,Organize meta-data,Convenient and flexible,Part 2,I/O Enhancements,Sliced datasets,Split I/O records,“Header” maps,Dual User Interface,Script (power users),GUI (casual user),Programming Language,Fortran (legacy),C (legacy, internals, glue),Java (modernization),Poster,Sliced Datasets,Data handling is fundamental,File2,File1,File0,T,X,W,Dictionary,Binary,axis=,x w,file=,Multiple dictionaries (views),Free,merge or distribute,One dictionary + N binaries,One dictionary + One binary,View 1axis=x,New,View 3axis=x,View 2axis=x,W,1,W,2,W,N,Parallel I/O, capacity management,Edit On-the-Fly,Data handling is fundamental,File0,T,X,W,Dictionary,Binary,axis=,x w,. . .,order= w -x,file=,New,Logical Sorts,Limit Range,Decimate Input,Split I/O Records,Data handling is fundamental,Samples,Headers,T,X,Y,Dictionary,Binary,split=,data=,Headers only (sort, stats, fold, edit, display, ),Read and write composite traces,Process and reattach headers,Samples only (transforms, ),New,SEPLib and RSFApplications,“Header” Map Enhancements,Vector Arithmetic for Fields,Expression based (+, -, *, /, ),All fields are created equal Sample vector is a “,header,”!,Popular Functions,Scalar and vector versions,Math, trig, statistics, ,1D Processing On-The-Fly,Read and write I/O routines,Format mapping routines,DDS onlysupports scalars,not vectors,Example Maps:,samples= 10 * abs(samples),max_idx= imax(samples) + 1,I/O System Integration!,Data Handling is Fundamental,Uniformly available to,ALL,applications Not restricted to the specialized,Supports random access Unlike pipe and filter sequences,Smart I/O Benefits,Maximum software reuse,Implementation compatibility,Minimize bandwidth and peak storage,Guided by end-user knowledge,Generic Formats and Maps,Key to interoperation and emulation,Maximize total value,Information exchangeamong applicationsregardless of pedigree,Smart I/O,Smart I/O =,generic formats+ “header” maps + emulation,+ random access + parallel I/O+ sliced datasets + record splits+ logical merge + on-the-fly sort+ input ranges + 1D processing+ ?,Beyond the I/O System,I/O Enhancements,Sliced datasets,Split I/O records,“Header” maps,Dual User Interface,Script (power users),GUI (casual user),Programming Language,Fortran (legacy),C (legacy, internals, glue),Java (modernization),User Interface,New,Power Users,Other Users,Favorite Editor,GUI Builder,Job Scripts,Batch,Interactive,Data Display and Plotters,Log Filters and Viewers,Datasets,Print Logs,Guided,Processing,Flexible,Convenient,GUI Job Builder,GUI builders and Job builders are both forms of high-level programming,Dont reinvent, leverage existing open source (Eclipse,NetBeans,),GUI,Display,Builder,Canvas:,Drag-n-drop widgets onto visual screen layout in a logical groups,Bean Menu:,Push buttons, , Sliders, Dialog boxes, ,Property Pop-ups:,Color, Size, Position, Labels, Limits, ,Relations:,Widget groups, Pop-ups, Selected disabling, ,Management:,Setup name, Canned macros, Save-Restore-Copy-Delete, ,Help:,F12, Search boxes, Context sensitive, Roll-over, ,Implementation:,Java Beans, Adaptors, Setup scripts, ,GUI,Job,Builder,Canvas:,same,Bean Menu:,Filter, Mute, Trace edit AGC, Stack, Migrate, ,Property Pop-ups:,Trace ranges, Frequency limits, Angles, ,Relations:,Parallel distribution, Input/Output connectors, ,Management:,same.,Help:,same,Implementation:,same,New,Analogy,X-Window Widget Java Bean,Language Strategy,Java,Fortran,C,System Internals,Applications,Legacy softwareand skills,Future directionof technology,Foundationfor transition,shells,Jython,PSEIS Architecture Summary,Successor to DDS,Keep the good, fix the bad, plus new ideas,Superior functionality, robustness, usability,Interoperation and emulation,Script and GUI,Research convenience,Production efficiency,Fortran, C and Java,Soliciting Support and Participation,Finalize design,Implement,Integrate,Maximize Total Value,Embrace diversity,Collaboration,Technology transfer,“,Missing Link,” for evolution,Next,Parallel programming,Acknowledgement,Many people have contributed to and supported DDS and PSEIS.,The following deserve special thanks:,Joe Dellinger, BP,John,Etgen, BP,Jerry Ehlers, BP,Jin Lee, BP,Kurt,Marfurt, University of Houston,Dan Whitmore, ConocoPhillips,Thanks are also due BP for releasing DDSas Open Source Software and for permissionto publish this work.,