Autoplot Application (pw-hudson-437)

multiple events are now shown when there are overlaps.

Autoplot attempts to allow plotting of data from many data sources, including local files and OpenDAP servers. Datasets are identified with URIs, and by the URI's extension a module is used to load the data into the internal data model. Data is then displayed by guessing the rendering method and axis ranges to provide a reasonable, useful view of the data.

This is the Autoplot2012b branch. This is an update to the production version containing bugfixes and minor new features.

Single-jar version, autoplot.jar, can be run without network access and from the command line. Note CDFs are only supported via the Java-based reader and Autoplot will attempt to use it when the C-based version is not available.

Bugfixes:

• add logging to aggregation to figure out why Dan's seeing inconsistent behavior
• local paths with /tmp in the path would fail.
• hugeScatter repaints properly, finally...
• cdf-java attempts to read to memory outside JVM, then falls back to JVM memory
• 3586029: progress monitor cancel enabled for setTaskSize 1 of 3 (CDAWeb)
• rte_0818219940: null pointing when editing bookmarks
• 3586030: one record of waveform data didn't autorange properly
• polar_fnl_ceppad-HISTe-lsort-l3_19970101_v1.0.0.cdf shows null pointer because failed to check for dimSizes=null
• 3586034: multiple monitors on some Windows 7 locks up. (Possible fix)
• validate data as it is read into aggregations to improve feedback
• George's problem where aggregation didn't work because of bug with reading 1-record CDFs
• shrink-vap-to-fit now scales fonts (and ems for layout) as well.
• 3585373: CDF Java fails immediately with out of memory. First attempt outside-JVM memory, then fall back to within JVM
• first progress indicator for loading in Ephemeris
• hugeScatter handles incorrect units like the scatter mode, putting up warning but plotting data anyway.
• TCAs (Emphemeris) in vap files are handled properly, so the date label is turned of when load a vap with emphemeris
• time range editor doesn't forget orbit number
• jython editor scroll increment set properly when editor has lots of arguments.
• sparse variables in Native CDF supported.

Older Bugfixes:

• rte_0686841638: [] in qstream comments are now okay
• rte_0018238427: URI is not absolute, when exporting on Windows
• Messenger CDF variable uses sparse records. Implement sparse records for native library, Java needs work.
• pngwalk tool supports .pngwalk files from within the tool, before they wouldn't show up in completions.
• .pngwalk files work properly when versioning is used.
• singleInstanceListener detects "pngwalk:" and does this automatically in a new pngwalk.
• in aggregation dialog, use a JTextField so long URIs don't mess up the GUI.
• tweak menu labels in the file menu
• fix one place in CDF codes where FUNCTION wasn't support were FUNCT was. FUNCT is the new word.
• IndexOutOfBounds RTE in Pngwalk filmstrip view
• Jython negative indeces were supported for ranges (ds[-3:-1]) but not for single indexes (ds[-3]) or lists (ds[[-3,-2,-1]]
• 3579786: LSpec routine handles fill more gracefully
• LSpec would shift result one bin
• 3578171: code clean up broke forgotten feature where an http file could be plotted even if it wasn't part of http filesystem. Thanks Tami and Darren!
• 3578229: orbit 00003 and 3 were not recognized as equivalent as other codes see it, so pngwalks would fail.
• 3577939: orbit files must have at least one valid orbit because mediawiki doesn't provide file-not-found code
• make pngwalk would fail to show pngwalk when version was used. Thanks Matt!
• 3578898: improve feedback in spectograms when all timetags appear to be fill.
• rte_1710483042: check for RENDER_TYPE assumed that the result was non-null.
• rank 2 depend_1 can switch back and forth between stack of line plots and spectrogram
• reduce the number of processor threads (for now) in hopes to reduce load on Dan's server, which sometimes drops plots
• events data set in qdataset didn't render properly because under-implemented copy method dropped properties.
• fixes for bugs found in CDAWeb source discovered by Bob's plot everything script.
• old "|slice(2)" was mis-handled in metadata sprocess, causing RTE

Features:

• events renderer mouse show multiple events for overlaps
• scale=T added to export to wav, GUI added as well.
• allow jump into jyds editor from built-in editor.
• RBSP orbits come from one of three servers for robustness, and embedded within jar for offline use.
• introduce GUI for picking timeranges, look for the "calendar" icon on the time range editor.
• allow scripts, like the digitizer application, to register a hook that prevents exiting and loosing work.

Less recent features:

• stack of lineplots view when CDF Y Tags are rank 2
• hidden feature allows state files to be saved with each undo state. See http://sarahandjeremy.net/~jbf/autoplot/script/enableStateSupport.jy
• delegate granule in aggregation is based on timerange, if available
• New QDataSet.NOTES allows datasets to be annotated, initially to document where AggregatingDataSource encounters exceptions in reads
• new LSpec.rebin produces data on fixed cadence

Known issues:

• see Source Forge

This completes the feature set for the new production branch. No major features will be added before branching this version. A production branch will be started in a couple of weeks, and the "Start Autoplot" link at the top of autoplot.org will run this version. Feedback on the function and quality of this release is greatly appreciated!

data is input from:

• ASCII files (.dat,.txt)
• CSV files (.csv)
• Binary files (.bin)
• CDF files(.cdf)
• Excel spread sheets (.xls)
• das2Streams (.d2s or .das2Stream)
• ViRBO's TSDS server
• CDAWeb data server (vap+cdaweb:)
• das2servers (vap+das2server:)
• QStreams (.qds), QDataSet on a das2Stream
• Plasma Wave Group das2 Server
• NetCDF files (.nc,.ncml)
• HDF5 files (.h5,.hdf5)
• DODs servers (.dds)
• Cluster Exchange Format files (.cef)
• Fits Format Files
• Images (.jpg, .png, .gif)
• Wav audio files (.wav)

This is not complete, and limitations include:

• Quantities of rank 3 dimensionality (e.g. flux(Time,Energy,pitch) are plotted by slicing.
• Quantities of rank 4 dimensionality (e.g. flux(Time,Energy,azimuth,sector) are plotted by slicing twice.

autoplot.org is the wiki website, and contains more information than this launch page.