SciQlop Status
Priorities : Google doc link
Scientific Objectives and Performances



Functionnality
Status(% done)




SciQLOP should be portable, and an executable/setup should be available for Linux, Mac, Windows
50


Installing SciQLOP must be easy, must not require to read a documentation or install dependencies
50


When opened SciQLOP should by default reload the previous state (data products, plots, plugins, etc.)
0


SciQLOP comes with good user documentation, including galleries, examples and tutorials including video tutorials.
50


SciQLOP should propose the same functionalities on all platforms.
50


SciQLOP should propose the same performances on all platforms.
50


SciQLOP's GUI should remain light, beautiful and intuitive
50


Exploring databases, browsing data should be easier/faster than with other existing softwares
90


SciQLOP should provide efficient and transparent data browsing, access to user python routines, collaborative cataloging features with and without machine learning
0


SciQLOP should remain responsive when plotting 10 millions of points on a standard machine.
90


SciQLOP should have a limited list of data type it can handle and group them by common traits (scalars, vectors, image...).
100


SciQLOP may be able to provide features depending on the data type, source, unit or any condition/property the user may define or program.
50


Each modification of the data between the source (server) and the plot should be documented
?


SciQLOP should be used by students as a formation tool : provide users with knowledge toolkits associated to used quantities
?


SciQLOP should provide users with easy access to documentations on data, missions, instruments, etc.
90


SciQLOP should allow users to access wikipedia plasma/mission-related articles and suggest users to edit/add content.
0


SciQLOP should allow users to save and restore sessions.
0


SciQLOP user session should contain all data to restore its previous state.
0



Code redistribution



Functionnality
Status(% done)




SciQLOP source code will be GPLv2.
100


SciQLOP source folder should contain the files:README, INSTALL, COPYING, CHANGELOG.
0


All SciQLOP source files should contain GPLv2 header.
100


All SciQLOP dependencies should be compatible with GPLv2.
90



Code versioning



Functionnality
Status(% done)




SciQLOP source code modifications should have a link between features or bug corrections and code revisions
50


SciQLOP source code should be hosted on the laboratory server hephaistos1 with the mercurial version system.
100



h2.Code Writing



Functionnality
Status(% done)




SciQLOP developer's documentation, roadmap, issues, etc. will be done on the Redmine application : https://hephaistos.lpp.polytechnique.fr/redmine/projects/sciqlop
100


Unit test are developed for all modules and performed after each important merge
90


SciQLOP's code is homogeneous in its syntax and philosophy to guarantee easy maintainability.
100


SciQLOP's code is self-explanatory, comments are used to explain goals, methods rather than instructions. Comments record development flow (hacks, todos, etc.)
95


SciQLOP's code is based on the Qt framework and plotting capabilities use the QtCharts API.
100



SciQLop Modules



Functionnality
Status(% done)




Core



Database



All the native data types SciQLOP should be handled
100


Database module should allow to associate commands/functions on data/data types from GUI.
50


Database module should provide a way to view loaded products.
100


Database module GUI should show if a product is in use and by which module(Plot5, plugin2, PythonContext...).
0


Database module GUI should show which plugin provide the data .
0


Origin of the data should be associated with metadata. Ex: if product comes from a file, display the path and file metadata (dates, size, permissions etc.). If from datadownloader, display which one, i.e. amda, cdaweb etc.
0


Data products are accessible through a tree dynamically built with a filter
100


Users can easily access metadata on data products (mission, resolution, unit, etc.) by interacting with the tree
95


Default tree representations are proposed to the user - TBD
?


Caveat and other useful information usually present in headers are available from the database's GUI
0


Database representation should highlight data products when selected on plots
0


Any data imported into the user session, whether it is from a file, or from the Space data Module must be added to the database
0


Garbage collector - TBD
?


Each data product in the database acquires a unique identifier
100


Data products loaded from into the database are not mutable.
100


Users should be able to delete a product from the database through contextual menu
100


Deleting a product from the Database checks whether the product is still in use. If so warns the user that all plots will be updated accordingly
95 don't warn


Multiple occurences of the same dataproducts (i.e. database entry differing by their UID, and possibly time interval) are grouped under the same data product name in the tree and appear by their UID/plot
0


Database also show the currently defined variables in the python session, in a separate tab. Although python variables, like data products, contain data, they differ by being mutable and not associated with rich metadata such as origin, etc
0


Users can manually add a python function to the database in the context menu
0


Data Downloader



Data downloader should be a singleton.
100


Data downloader may implement most protocols.(HTTP, FTP, WebDav...)
?


Data downloader should handle proxy server.
100


Data downloader should know when data asked by the user is locally accessible already.
0


Python Engine



SciQLOP functionalities are scriptable through the ipython terminal.
0


Users can interact with the database through python, he may be able to pull data from database to python or push data from python to database.
0


Users can interact with any plot with python
0


User can grab data from plot or plot data with python
0


Data in the python terminal is implemented as nimpy array and DataFrames objects, with time as index
0


GUI Manager



GUI manager should be a singleton
0


GUI manager may provide an interface to populate menus from any module
0


Catalogs & Community functionalities



Plot



General



SciQLOP should be able to plot all kinds of data relevant to space plasma missions(scalar, vector, tensor, spectrogram
100


Each plot element (context : colorbars, ticks, titles, labels etc. ; data : lines, style, dots, etc.) should be clickable and customizable
40


Controls on figure items should be identical in all kinds of plots (e.g. changing title, labels etc. is done identically for all kinds of plots).
100


A plot “style” (context and data style) can be copy/pasted onto another plot
0


Users may define custom plot styles and save/reload them as desired
0


Plots should provide visualization of available metadata (instrument modes, etc.)
0


Each plot/view should provide the context menu associated to the data type.
50


Each plot/view should allow the user to select a portion of data and perform specific operations on it, such as labelling it, building new plots or applying data analysis methods on it (e.g. get statistical quantities such as mean/std, etc.).
50


Data can be selected by dragging a zone onto the plot: Time interval as rectangle for time series for example. A box in 3d plot/view for example.
0


For time dependent data the plot/view may ask for more data when the user scrolls to the borders of the plot/view.
0


Users should experience no significant lag related to downloading data associated with scrolling windows
0


Each plot/view should allow the integration of custom controls (user defined gui widgets) provided by the current plotted data. The control may be provided as a QWidget.
0


Each plot/view should be easily duplicable.
0


Figures/plots can be linked together or not.
100


Linked plots will zoom/unzoom, scroll together (horizontally)
100


A Lens effect enables the user to zoom on a part of the data without changing the plot range (like a lens effect on Gimp-like software). This can be made by adding a plot window overlapped onto the plot.
0


Any plot should come with a default legend, customizable by the user
100


Any plot can be dragged to a folder and exported as an image (eps, png, jpg)
0


User can select multiple plots holding shift key and drag them onto a folder to export images. SciQLOP ask the user whether multiple images or a summary plot should be done.
0


Mouse wheel can be used to scroll in time when the figure is selected.
100


Plot adjustments controls appear on specific locations on mouse hover. This keeps the interface clear but still customizable.
0


Scalar Time series



Contextual menu should give users rapid access to statistical functionalities such as mean(), std().
0


Data holes are handled in line style mode as a line segment.
100


Line width can be adjusting by clicking+mouse wheel
0


Vector Time series



SciQLOP can plot one or more components of a vector as a function of time
0


SciQLOP is aware the quantity is part of a vector. If Bx is plotted it knows which products represent By and Bz and can easily add them on the plot.
0


The contextual menu on a vector plot should allow users to easily transform their vector into another basis, user-provided and generic basis such as GSE, GSM, etc. or MVA.
0


Vectors displayed on linked plots will be represented in the same basis dynamically (one change of basis on one of the linked plot will change all of them)
0


Vectors can be plotted in 3D or 2D-projection as 3D vectors as a function of time. This representation will be useful for visualizing aspects specific to vectors such as change of direction (e.g. waves & discontinuities) not easily viewable in the time series format.
0


Spectrograms



SciQLOP should enable the same plot/context functionalities for all spectrograms, no matter the nature of the data (particles or waves), this include color range, colormaps, etc.
100


Characteristic frequencies should be overplottable as time series.
0


Using WAMP for theoretical wave frequencies and damping should be possible
0


Plasma eigenmodes visualization toolkit can be called from the spectrograms contextual menu
0


Data holes are handled by showing the background color/texture
100


By clicking on the colorbar, color range can easily be adjusted from cursors appearing on the colorbar on mouse hover
0


Orbits



SciQLOP provides the user with three 2D projections of the magnetosphere/heliosphere and its key regions
0


Heliosphere/Magnetospheric plot use different models (Tsyganenko, shue, Parker Spiral, etc.) easily interchangeable by the user.
0


Orbits of the satellites from which data is currently being viewed appears overplotted on the three 2D magnetospheric/heliosphere projections
0


The position of the spacecraft for the considered intervals must be clearly visible on the trajectory with a colored portion of the orbit, the color being associated to a particular plot (or set of linked plots).
0


Changing the interval range of a spacecraft on its orbit must change the plot time range accordingly and dynamically.
0


SciQLOP should offer an interoperability with CDPP/3DView to view orbits in 3D
0


SpaceData



General



Satellites Data provider should provide an access to CDAWeb data over REST protocol.
100


Satellites Data provider may allow advanced pattern filtering for fast data retrieval
10


Satellites Data provider should allow generic search/filtering among data fields.
100


Satellites Data provider search/filter should accept regular expressions
?


App



Machine Learning