Metadata-Version: 1.1
Name: scikit-validate
Version: 0.4.0rc2
Summary: Science validation toolkit
Home-page: https://gitlab.cern.ch/fast-hep/public/scikit-validate
Author: Luke Kreczko
Author-email: kreczko@cern.ch
License: Apache Software License 2.0
Description: =================
        scikit-validate
        =================
        
        
        .. image:: https://img.shields.io/pypi/v/scikit-validate.svg
                :target: https://pypi.python.org/pypi/scikit-validate
        
        .. image:: https://readthedocs.org/projects/scikit-validate/badge/?version=latest
                :target: https://scikit-validate.readthedocs.io/en/latest/?badge=latest
                :alt: Documentation Status
        
        .. image:: https://badges.gitter.im/FAST-HEP/community.svg
                :target: https://gitter.im/FAST-HEP/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge
                :alt: Gitter
        
        
        * Free software: Apache Software License 2.0
        * Documentation: https://scikit-validate.readthedocs.io.
        * Issues: https://github.com/FAST-HEP/scikit-validate/issues
        
        Overview
        --------
        scikit-validate is a validation package for science output developed within `F.A.S.T.`_.
        This package provides commands for monitoring and comparing analysis outputs, \
        computing resource usage (e.g. CPU time/RAM) as well as commands for summarising findings.
        
        It is meant to provide analysis groups or small experiments with some of the fundamental features needed to\
        validate (i.e. compare to a reference) the outcomes of their code and to provide easy access to the results.
        
        Features
        --------
        
        * Collect metrics in JSON output
          * measure file metrics (e.g. size)
          * measure execution time and memory usage
          * compare to previous executions
        * compare ROOT files & plot discrepancies
        * create validation reports
        
        Credits
        -------
        
        This package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.
        
        .. _`F.A.S.T.`: https://fast-hep.web.cern.ch/fast-hep/public
        .. _Cookiecutter: https://github.com/audreyr/cookiecutter
        .. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage
        
        
        Make a new RELEASE
        ------------------
        
        .. code-block:: bash
        
           export RELEASE=X.Y.Z
           export CHANGELOG_GITHUB_TOKEN=<your github token>
           make release
        
        
        0.3.12
        ------------
        
        Fix
        ~~~
        - Added missing error info for section properties. [Luke Kreczko]
        - More readable debug messages for get_pipeline_job. [Luke Kreczko]
        - Wrong variable name for DEBUG messages. [Luke Kreczko]
        
        Other
        ~~~~~
        - Added debug output for io.download_from_gitlab. [Luke Kreczko]
        - Python-gitlab 1.8 has been released, removing workarounds and
          comments. [Luke Kreczko]
        - Removing py 3.9 for now as not all dependencies are available yet.
          [Luke Kreczko]
        - Python 3.9 not yet available on travis, use 3.9-dev instead. [Luke
          Kreczko]
        - Updated requirements_dev.txt. [Luke Kreczko]
        - CI: removed Python 2.7, 3.6. and 3.7, added python 3.8 and 3.9. [Luke
          Kreczko]
        - Feature: added debug output for get_pipeline_job. [Luke Kreczko]
        
        
        Changelog
        =========
        
        
        0.3.9
        ------------
        - Removed comment blocks in validation_detail template (would write
          passing entries in there resulting in large files for large projects)
          [kreczko]
        - Merge pull request #28 from FAST-HEP/kreczko-issue-27. [Luke Kreczko]
        
          Fixing issue #27: setup.py not compatible with Windows
        - Setup.py: fixed Unix path for find_commands default value. [kreczko]
        
        
        0.3.8
        ------------
        - Fixed history vs releases. [kreczko]
        - Make: add unreleased history at the top of HISTORY.rst (still needs
          manual edit) [kreczko]
        - New command: sv_version. [kreczko]
        - Merge pull request #18 from kreczko/kreczko-metric-diff. [Luke
          Kreczko]
        
          New command: sv_metric_diff
        - Fixed formatting. [kreczko]
        - Added documentation for sv_metric_diff. [kreczko]
        - New command: sv_metric_diff. [kreczko]
        - Merge pull request #17 from kreczko/kreczko-issue-16. [Luke Kreczko]
        
          Fixing issue 16: added system time to sv_execute
        - Fixed usage instructions for sv_execute. [kreczko]
        - Fixing issue #16: added system time to sv_execute. [kreczko]
        - Updated metric names for demo report. [Luke Kreczko]
        
        
        
        0.3.7
        ------------
        - Merge pull request #15 from kreczko/kreczko-sanatizing-report-configs.
          [Luke Kreczko]
        
          Sanatising report configs
        - Updated pytest and hypothesis dependencies. [kreczko]
        - Adjust all configs to reversed-order rendering. [kreczko]
        - Fixed reversed-order rendering for lists in templates. [kreczko]
        - Fixed sv_root_info for more complex structures. [kreczko]
        - Reversing the order of report config parsing. New order: first read
          full YAML then render each value. [kreczko]
        
        0.3.6
        ------------
        - Fix commit description in HISTORY. [kreczko]
        - Merge pull request #14 from FAST-
          HEP/BK_check_nones_compare_two_root_files. [Luke Kreczko]
        
          Add check in case we get a pair of Nones from load_values
        - Catch several more places where `None`'s will matter. [Ben Krikler]
        - Add check in case we get a pair of Nones from load_values. [Ben
          Krikler]
        
        0.3.5
        ------------
        - Io.unpack: fixed behaviour for numpy arrays vs lists. [kreczko]
        - Io.unpack: deal with empty flat arrays. [Luke Kreczko]
        
        0.3.4
        ------------
        - Added AssertionError to list of exceptions for converting ROOT
          branches to numpy arrays. [Luke Kreczko]
        
        0.3.3
        ------------
        - Merge branch 'master' of github.com:FAST-HEP/scikit-validate.
          [kreczko]
        - Merge pull request #13 from kreczko/kreczko-string-branches. [Luke
          Kreczko]
        
        - Fixing issues reported by LZ
        - Fixed tests for new test samples (extra branch) [kreczko]
        - Compare: restored old behaviour for strings. [kreczko]
        - Compare: make sure both arrays are same size and deal better with
          empty arrays. [kreczko]
        - Sv_root_diff: ommit string and object type arrays. [kreczko]
        - Ommit flattening arrays where impossible. [kreczko]
        - Added string branches to test samples. [kreczko]
        
        0.3.2
        ------------
        - Fix root_diff (draw_diff) crashing for string input. [kreczko]
        - Added hypothesis tests for vis.adjust_axis_limits. [kreczko]
        
        0.3.1
        ------------
        - sv_root_info: fixed mask for non-readable. [kreczko]
        
        0.3.0
        ------------
        - Merge pull request #12 from kreczko/kreczko-root-info. [Luke Kreczko]
        - Added sv_root_info for inspection of ROOT files with uproot
        - sv_root_info: fixed lint errors. [kreczko]
        - sv_root_info: added read test for non-obvious branches. [kreczko]
        - Added sv_root_info for inspection of ROOT files with uproot. [kreczko]
        
        0.2.24
        ------------
        - When getting pipeline jobs: filter for only the last iteration of a
          particular job. [kreczko]
        
        0.2.23
        ------------
        - Fix git.create_patch behaviour for empty diffs. [kreczko]
        
        0.2.22
        ------------
        - Cpp_check_format: added "--exclude" parameter. [kreczko]
        - Cpp_check_format: fixed patch file (missing new line at the EOF)
          [kreczko]
        
        
        0.2.20
        ------------
        - Added ability to overwrite default cpp_check_format template.
          [kreczko]
        - Cpp_check_format report: separated path & command variables. [kreczko]
        
        
        0.2.19
        ------------
        - Sv_cpp_check_format: fixed return code. [kreczko]
        
        
        0.2.18
        ------------
        - Sv_cpp_check_format: fixes issues with instructions. [kreczko]
        
        
        0.2.17
        ------------
        - Sv_cpp_check_format: fixes issues with detached head. [kreczko]
        - Merge pull request #11 from kreczko/kreczko-cpp_format. [Luke Kreczko]
        
        - New CI check: sv_cpp_check_format
        
        
        0.2.16
        ------------
        - Added wrappers for git commands. [kreczko]
        - Sv_cpp_check_format: added report creation & publishing. [kreczko]
        - Sv_cpp_check_format: added file retrival, formatting and patch
          creation. [Luke Kreczko]
        - Added draft for cpp_check_format. [kreczko]
        
        
        0.2.15
        ------------
        - Collapsible details for detailed validation report (issue #8)
          [kreczko]
        - Extending gitignore for test files. [kreczko]
        - Updated history & changelog. [kreczko]
        - Fixed HISTORY formatting. [kreczko]
        - Fixed release example in README. [kreczko]
        - CI: updated user & password for travis-ci.com. [kreczko]
        
        
        0.2.14
        ------------
        - Merge pull request #9 from kreczko/kreczko-issue-8. [Luke Kreczko]
        
          Collapsible details for validation report (issue #8)
        - CI: more verbose install. [kreczko]
        - CI: updating Ubuntu distribution from 14.04 to 16.04. [kreczko]
        - CI: added demo report. [kreczko]
        - CI: added "make install" to script. [kreczko]
        - CI: installing packages needed for development. [kreczko]
        - Collapsible details for validation report (issue #8) [kreczko]
        - Fix travis config. [kreczko]
        - Updated travis condition for deployment. [kreczko]
        - Merge pull request #7 from kreczko/kreczko-travis. [Luke Kreczko]
        
          Updating travis to follow Gitlab CI
        - Added Gitter link to README. [kreczko]
        - README: added URL to issues. [kreczko]
        - Updated travis to follow .gitlab-ci.yml. [kreczko]
        
        
        0.2.13 (2019-05-13)
        -------------------
        - Merge branch 'kreczko-reduce-timeouts' into 'master' [Lukasz Kreczko]
          Reduce timeouts during artifact download
          See merge request fast-hep/public/scikit-validate!14
        
        
        0.2.12
        ------------
        - Added timeout to job artifact download. [kreczko]
        - Merge branch 'kreczko-docs' into 'master' [Lukasz Kreczko]
        
          Documentation "day" summary
        
          See merge request fast-hep/public/scikit-validate!13
        - Docs: expanded README and added quickstart draft. [kreczko]
        - Docs: added custom CSS. [kreczko]
        - Docs: switched from alabaster to sphinx_rtd_theme. [kreczko]
        - Docs: added logo. [kreczko]
        - Fixed flake8. [kreczko]
        - Docs: added sphinxcontrib-apidoc extension. [kreczko]
        - Fixed Sphinx documentation warnings. [kreczko]
        - README: Fixed badges and bullet list indents. [kreczko]
        - Docs: fixed typo to GitLab repo. [kreczko]
        - Merge branch 'kreczko-better-error-messages' into 'master' [Lukasz
          Kreczko]
        
          Improvements to reporting: error messages & quality of life
        
          Closes #6
        
          See merge request fast-hep/public/scikit-validate!12
        - Fixed issue #6: Bug: gitlab.get_pipeline_job returns first job only.
          [kreczko]
        
        0.2.11
        ------------
        - Download_validation_outputs: do not append validation job name if
          already part of path (e.g. user defined) [kreczko]
        
        0.2.10
        ------------
        - Validation report: batch size and line breaks are now configurable.
          [kreczko]
        - Gitlab.download_artifact will skip download if output file exists.
          [kreczko]
        - Report: added debug information for validation report. [kreczko]
        - Report: moved parsing errors their respective subsections. [kreczko]
        
        
        0.2.9
        ------------
        - Merge branch 'kreczko-report-tuning' into 'master' [Lukasz Kreczko]
          Fine-tuning reporting
          Closes #5
          See merge request fast-hep/public/scikit-validate!11
        - Report: allow file download to fail (e.g. failed jobs in pipeline)
          [kreczko]
        - Validation report: increased the number of images per row from 5 to 8.
          [kreczko]
        - Validation report: simplified image loading. [kreczko]
        - Gitlab artifact url: normalize path before use to exclude ".."
          [kreczko]
        - Validation report: added tests for _get_links_for_reports. [kreczko]
        - Test_gitlab: added path_type to URL test. [kreczko]
        - Validation report: separate report creation from link creation.
          [kreczko]
        - Validation report: add links to original images. [kreczko]
        - Validation report: switched details from HTML to PDF output. [kreczko]
        - Validation report: remove unused loop variable. [kreczko]
        - Validation report: reduced image size & added overview. [kreczko]
        - Sv_root_diff: fixed incorrect function name for processing. [kreczko]
        - Sv_root_diff: added multi-processing support. [kreczko]
        - Sv_root_diff: added reason for UNKNOWN status. [kreczko]
        - Vis.draw_diff: trying to make plotting thread-safe. [kreczko]
        - Sv_root_diff: added progressbar. [kreczko]
        - Sv_root_diff: parallelised using threads. [kreczko]
        - Added new command: sv_absolute_to_relative_path. [kreczko]
        - Sv_execute: units are a separate entry --> shorten metric names.
          [kreczko]
        - Gitlab: always take local file path as relative to project path for
          URLs. [kreczko]
        
        0.2.8
        ------------
        - Sv_make_report: fixed memeory_profile output file names for commands
          that include paths. [kreczko]
        
        0.2.7
        ------------
        - Sv_root_diff: fix _reset_infinities for empty values. [kreczko]
        
        
        0.2.6
        ------------
        - Merge branch 'kreczko-root-diff-tuning' into 'master' [Lukasz Kreczko]
          Bug fixes & generalisation for sv_root_diff
          See merge request fast-hep/public/scikit-validate!10
        - Vis.find_limits: fixed behaviour for empty arrays. [kreczko]
        - Added unpack np array function to serialize JSON. [kreczko]
        - Sv_root_diff: fixed issue with comparison between empty entries.
          [kreczko]
        - Sv_root_diff: added more information for WARNING & FAILED statuses.
          [kreczko]
        - Compare: added maxRelativeDifference and generalized is_ok function.
          [kreczko]
        - Sv_root_diff: switch WARNING color from invalid "orange" to valid
          "Orange3" [kreczko]
        - Sv_root_diff: improve robustness for 2D arrays and arrays of strings.
          [kreczko]
        
        
        0.2.5
        ------------
        - Sv_execute: replace _thread with six.moves._thread. [kreczko]
        - Sv_execute: replaced thread with six._thread. [kreczko]
        - CI: increased sleep time for report stage. [kreczko]
        - Sv_execute: memory profile monitoring now in separate thread.
          [kreczko]
        
        
        0.2.4
        ------------
        - Added software module to setup.py. [kreczko]
        
        0.2.3
        ------------
        - Added gitlab.get_pipeline_url. [kreczko]
        
        0.2.2
        ------------
        - Merge branch 'kreczko-memory-profile' into 'master' [Lukasz Kreczko]
        
          Adding memory profiles to validation report
        
          See merge request fast-hep/public/scikit-validate!9
        - CI: added delay of 60 seconds to report stage. [kreczko]
        - CI: added PNG files to artifacts for report stage. [kreczko]
        - Performance report: switched from raw link to dressed link for
          profiling image. [kreczko]
        - Updated example root_diff files with new plotting style and command
          (root_diff -> sv_root_diff) [kreczko]
        - Moved plotting style definitions from vis.profile to vis. [kreczko]
        - CI report: fixed typo in report configuration. [kreczko]
        - CI: fixed URL for reference memory profile. [kreczko]
        - Gitlab: fix relative import for Python 2.7. [kreczko]
        - Gitlab.DiskStreamer: create dowload directory if it does not exist.
          [kreczko]
        - Gitlab.get_jobs_for_stages: fixed typo in debug message. [kreczko]
        - Report: memory profile now return full URL (local or CI) [kreczko]
        - Fixed download_from_gitlab. [kreczko]
        - CI: source instead of execute. [kreczko]
        - Fixed lint errors. [kreczko]
        - Implemented vis.draw_profile. [kreczko]
        - Fix newlines when reading & writing the memory_profile. [kreczko]
        - Fixed profile dictionary for profile template. [kreczko]
        - Remaned example memory profile files. [kreczko]
        - Added memory_profile to demo report. [kreczko]
        - Fixed paths for memory profile files in CI report. [kreczko]
        - Raised min. version for memory_profiler to 0.54 (first with mprof
          module) [kreczko]
        - Added memory profile data examples. [Lukasz Kreczko]
        - Added vis.profile. [Lukasz Kreczko]
        - Report: changed import of vis module, draw_profiles -->
          vis.draw_profiles. [Lukasz Kreczko]
        - Added profile to CI report. [Lukasz Kreczko]
        - Added processing of profile files to report. [Lukasz Kreczko]
        - Added processing for memory profile timestamps. [Lukasz Kreczko]
        - Added function to split memory_profiler output from multiple commands.
          [Lukasz Kreczko]
        - Using a single profile file for memory_profile. [Lukasz Kreczko]
        - Switched memory_profile from just the exe to the full command (as done
          for the metrics) [Lukasz Kreczko]
        - Added downloaded files to report artifacts. [Lukasz Kreczko]
        - Downloading performace JSON and memory profiles for performance
          report. [Lukasz Kreczko]
        - Added special keyword "download" to report sections. [Lukasz Kreczko]
        - Added documentation draft for report config. [Lukasz Kreczko]
        - Added download capability to io package. [Lukasz Kreczko]
        - Added gitlab.get_pipeline_job. [Lukasz Kreczko]
        - Split performance validation across two jobs. [Lukasz Kreczko]
        - Added memory profile to CI. [Lukasz Kreczko]
        - Added memory profile to sv_exectute. [Lukasz Kreczko]
        - Added memory_profiler as dependency. [Lukasz Kreczko]
        - Merge branch 'BK_allow_multiple_argument_cmds' into 'master' [Lukasz
          Kreczko]
        
          Add support for mutiple positional arguments being used as the command to run
        
          See merge request fast-hep/public/scikit-validate!8
        - Use new command-line style in ci. [Ben Krikler]
        - Remove TODO comment that I'd added. [Ben Krikler]
        - Add support for mutiple positional arguments being used as the command
          to run + pep8. [Ben Krikler]
        
        
        0.2.1 (2019-03-12)
        ------------------
        - Merge branch 'kreczko-rename-commands' into 'master' [Lukasz Kreczko]
        
          More user-friendly command names
        
          See merge request fast-hep/public/scikit-validate!7
        - Switch to new command names in the CI. [Lukasz Kreczko]
        - Updated command names & added TODOs. [Lukasz Kreczko]
        - All commands now start with "sv\_" [Lukasz Kreczko]
        
        
        0.2.0
        ------------
        - Merge branch 'kreczko-better-validation-report' into 'master' [Lukasz
          Kreczko]
        
          Added better validation report
        
          See merge request fast-hep/public/scikit-validate!6
        - New command: submit_report_to_mr to add reports to the MR. [kreczko]
        - Fix update of existing note in MR for report. [kreczko]
        - Fix overwritting of values for detailed report. [Lukasz Kreczko]
        - Fix validation detail template & remove debugging. [Lukasz Kreczko]
        - Fix missing summary report. [Lukasz Kreczko]
        - Made updating merge request with report available for GitLab < 11.6.
          [Lukasz Kreczko]
        - Fixed job_name. [Lukasz Kreczko]
        - Added reporting to parent merge request. [Lukasz Kreczko]
        - Added io.resolve_wildcard_path. [Lukasz Kreczko]
        - Added job_name variable to detailed validation report. [Lukasz
          Kreczko]
        - Fixed report.format_software_versions. [Lukasz Kreczko]
        - Added tests for report.format_software_versions. [Lukasz Kreczko]
        - Reraising exception for template rendering. [Lukasz Kreczko]
        - Added logging. [Lukasz Kreczko]
        - Remove automatic reporting for now. [Lukasz Kreczko]
        - Added debugging for validation detail template. [Lukasz Kreczko]
        - Added HTML and PDF output formats for validation report. [Lukasz
          Kreczko]
        - Replacing pdfkit with xhtml2pdf. [Lukasz Kreczko]
        - Added PDF output for validation HTML. [Lukasz Kreczko]
        - Added pdfkit dependency. [Lukasz Kreczko]
        - Added reporting to merge request. [Lukasz Kreczko]
        - Added documentation for validation report. [Lukasz Kreczko]
        - Replaced image & validation_detail URLs with RAW urls. [Lukasz
          Kreczko]
        - Downloading relevnt validation artifacts. [Lukasz Kreczko]
        - Added download to disk option for gitlab.download_artifact. [Lukasz
          Kreczko]
        - Added ls for report job (debugging) [Lukasz Kreczko]
        - Resolve image paths for validation jobs. [Lukasz Kreczko]
        - Added validation reports to CI artifacts. [Lukasz Kreczko]
        - Extract distributions from validation_json before passing them on.
          [kreczko]
        - Fixed prefix path for output_path in root_diff. [kreczko]
        - Added missing output JSON for validate-root-diff-1_3. [kreczko]
        - Fixed incorrect function calls. [kreczko]
        - Added job_filter to GitLab job retrieval. [kreczko]
        - Added validation report to CI. [kreczko]
        - Switched Demo report to use more general values. [kreczko]
        - Added more performance metrics. [kreczko]
        - Added detailed validation report. [kreczko]
        - Replaced demo report validation with new summary. [kreczko]
        - Added validation summary. [kreczko]
        - Added error reporting in validation template. [kreczko]
        - Root_diff: added output_path to JSON output. [kreczko]
        - Fixed tests for compare_two_root_files. [kreczko]
        - Fixed lint issues. [kreczko]
        - CI: fixed dependency for report. [kreczko]
        - Added draft for validation detail. [Lukasz Kreczko]
        - Tidied up symbols for demo report. [Lukasz Kreczko]
        - Added 3rd validation example. [Lukasz Kreczko]
        - Added examples for root_diff. [Lukasz Kreczko]
        - Generalised gitlab download of JSON data. [Lukasz Kreczko]
        - Added prefix to root_diff. [Lukasz Kreczko]
        - Split root_diff validation job into two jobs (1 for each comparison)
          [Lukasz Kreczko]
        - Added root_diff summary. [Lukasz Kreczko]
        - Making all produced JSON files human-readable. [Lukasz Kreczko]
        - Added proper reporting to root_diff. [Lukasz Kreczko]
        - Moved reseting infinities from draw_diff to root_diff. [Lukasz
          Kreczko]
        - Added short-hand option for root_diff:out-dir. [Lukasz Kreczko]
        - Added first version of the logo. [kreczko]
        - Merge branch 'kreczko-gitlab-access' into 'master' [Lukasz Kreczko]
        
          First functional draft for pipeline reports
        
          See merge request fast-hep/public/scikit-validate!5
        - Fixed web_url_raw in gitlab.get_jobs_for_stages. [kreczko]
        - Added skvalidate.report.get_jobs_for_stages. [kreczko]
        - Moved report.demo._format_status to report.format_status. [kreczko]
        - Ok -> success, fail -> failed to be more consistent with gitlab.
          [kreczko]
        - Link -> web_url to be more consistent with gitlab. [kreczko]
        - Allow for artifact download to fail. [kreczko]
        - Fixed prefix for detect_software_versions in CI. [kreczko]
        - Made software_version retrieval more resilient against missing data.
          [kreczko]
        - Fix streamer for bytestrings. [kreczko]
        - Returning to previous version but with additional error-handling.
          [kreczko]
        - Updated python-gitlab to latest master to avoid workaround. [kreczko]
        - Made install procedure a bit more quiet. [kreczko]
        - Added workaround for python-gitlab bug. [kreczko]
        - Make installation of dependencies & after_script silent. [kreczko]
        - Report: print section properties on error. [kreczko]
        - Added robustness to performance report: only format as number if
          variable is a number. [kreczko]
        - Added quiet option for detect_software_versions. [kreczko]
        - Enable streaming for gitlab job artifact retrieval. [kreczko]
        - Replaced CI_ATUH_TOKEN with read-only API token from bot-account.
          [kreczko]
        - Fixed name for software_versions.json in CI. [kreczko]
        - Added gitlab package. [kreczko]
        - Fixed detect_software_versions after_script. [kreczko]
        - Fixed unused module in get_artifact_url command. [kreczko]
        - Added reporting to current CI. [kreczko]
        - Added gitlab connectors. [kreczko]
        - Restricting gitlab dependency to be >=1.7.0. [kreczko]
        - Moved logic from get_artifact_url command to skvalidate.gitlab.
          [kreczko]
        - Re-enabled status symbols. [kreczko]
        - Updated gitlab report config with pipelines and latest validation
          section. [kreczko]
        - Added prefixes to scan_software_version to allow for multiple
          environments names. [kreczko]
        - Removed obsolete function in report. [kreczko]
        - Added validation info from JSON. [kreczko]
        - Fixed table in pipeline template. [kreczko]
        - Fixed lint in .software. [kreczko]
        - Io: made save_metrics_to_file more general. Now have
          update_data_in_json,write_data_to_json & read_data_from_json.
          [kreczko]
        - Added new pipelines to demo report. [kreczko]
        - Added lower_is_better value to metrics. [kreczko]
        - Added output file for detect_software_versions. [kreczko]
        - Added detect_software_versions command. [kreczko]
        - Replaced build, test and software sections in report with pipeline
          section. [kreczko]
        - Added markdown2 as new dependency. [kreczko]
        - Fixed commands and metric names for performace and file report.
          [kreczko]
        - Added "make_report" command. [kreczko]
        - Removed obsolete print statement. [kreczko]
        - Added plumbum as new depedency. [kreczko]
        - Merge branch 'kreczko-update-metrics' into 'master' [Lukasz Kreczko]
        
          Fixed printouts for add_file_metrics & execute_with_metrics
        
          See merge request fast-hep/public/scikit-validate!4
        - Fixed tests for new-style metrics. [kreczko]
        - Moved report.demo.get_metrics -> report.get_metrics. [kreczko]
        - Fixed printouts for add_file_metrics & execute_with_metrics. [kreczko]
        - Merge branch 'kreczko-update-metrics' into 'master' [Lukasz Kreczko]
        
          Updated metrics for add_file_metric & execute_with_metrics to new-style metrics
        
          See merge request fast-hep/public/scikit-validate!3
        - Fixed name of performance metrics in CI. [kreczko]
        - Added validation of the metrics pipeline (run & file metrics ->
          report) to the CI. [kreczko]
        - Updated execute_with_metrics to produce new-style metrics. [kreczko]
        - Updated file metrics to new style. [kreczko]
        - Merge branch 'kreczko-backwards-compatible-metrics' into 'master'
          [Lukasz Kreczko]
        
          Added backwards compatible metrics
        
          See merge request fast-hep/public/scikit-validate!2
        - Fixed linter issues. [kreczko]
        - Converting metrics from old to new by default. [kreczko]
        - Added method to convert from old to new metrics. [kreczko]
        - Moved skvalidate.compare.compare_metrics to
          skvalidate.compare.metrics.compare_metrics. [kreczko]
        - Fixed typo in compare_metrics. [kreczko]
        - Merge branch 'kreczko-report' into 'master' [Lukasz Kreczko]
        
          Added report creation functionality
        
          See merge request fast-hep/public/scikit-validate!1
        - Moved data to skvalidate/data. [kreczko]
        - Added report package. [kreczko]
        - Trying indirect call to make_demo_report in CI. [kreczko]
        
        0.1.8
        ------------
        - Run demo report under python 3.7. [kreczko]
        - Added Jinja2 to dependencies. [kreczko]
        - Added demo_report to validation stage. [kreczko]
        - Fixed potential Python2 syntax problems. [Lukasz Kreczko]
        - Added PyYAML as a dependency. [Lukasz Kreczko]
        - Fixed lint errors. [Lukasz Kreczko]
        - Make report: output file now as command line argument instead of
          config. [Lukasz Kreczko]
        - Added metric comparison functionality. [Lukasz Kreczko]
        - Fixed metric templates (files & performance) [Lukasz Kreczko]
        - Added metric examples. [Lukasz Kreczko]
        - Made tests more verbose. [Lukasz Kreczko]
        - Updated gitlab report config & name. [Lukasz Kreczko]
        - Updated template paths in demo report config. [Lukasz Kreczko]
        - Moved config into data folder. [Lukasz Kreczko]
        - Added draft for reporting. [Lukasz Kreczko]
        - Added status symbols to demo. [Lukasz Kreczko]
        - Moved templates to data folder. [Lukasz Kreczko]
        - Made default templates more resilient. [Lukasz Kreczko]
        - Added default report templates. [Lukasz Kreczko]
        - Added example report configs. [Lukasz Kreczko]
        - Improved development install. [Lukasz Kreczko]
        
        0.1.7
        ------------
        - Add_file_metrics: added fix for Python3 & test. [kreczko]
        
        0.1.6
        ------------
        - Execute_with_metrics: added fix for Python3 & test. [kreczko]
        
        0.1.5
        ------------
        - Made run-clang-tidy Python3 compatible. [kreczko]
        - Fixed pep8 error in vis. [kreczko]
        
        0.1.4
        ------------
        - Disabled log scale for diff plot. [kreczko]
        - Setting minY to non-zero for logarithmic plots. [kreczko]
        - Disabled logY setting if negative values are found. [kreczko]
        
        0.1.3
        ------------
        - Execute_with_metrics: added soft-fail to IOException on writing
          metrics file. [kreczko]
        - Added tests for get_target_branch. [kreczko]
        - Fix missing import. [kreczko]
        
        0.1.2
        ------------
        - Improved error-handling for get_target_branch and added target &
          default branches. [kreczko]
        - Worked through the stricter pep8 set. [Lukasz Kreczko]
        - Added default target_branch to get_target_branch. [Lukasz Kreczko]
        
        0.1.1
        ------------
        - Visualisation adjustments for root_diff. [kreczko]
        - Fixed python3 issues with io._walk. [kreczko]
        
        0.1.0
        ------------
        - Replaced io._walk with a more robust equivalent. [kreczko]
        - Added automated logy & x-limits to drawing. [kreczko]
        - Added code to generate tests/samples/objects.root. [kreczko]
        - Steeled diff calculation, fixed normalisation (now w.r.t. reference)
          and reporting non-comparible branches in root_diff. [kreczko]
        - Made io.unpack more robust to str-arrays. [kreczko]
        - Fixed pep8 error: unused include in test_io. [kreczko]
        - Fixed "make test" [kreczko]
        
        0.0.7
        ------------
        - Added comparison of object data to tests. [kreczko]
        - Updated io.walk to handle & unpack objects. [kreczko]
        
        
        0.0.6
        ------------
        - Automatically expose commands directly to command line. [kreczko]
        - Made sure vector branches are flattened before comparison. [kreczko]
        - Updated tests for vector branch. [kreczko]
        - Added vector variable to test samples. [kreczko]
        
        0.0.5
        ------------
        - Added image examples for root_diff. [kreczko]
        
        0.0.4
        ------------
        - Added KS test to drawing. [kreczko]
        - Moved compare_two_root_files to compare.compare_two_root_files.
          [kreczko]
        - Fixed "a" branch in tests/samples/test_3.root. [kreczko]
        - Creating output/validate/test_1_3 in CI. [kreczko]
        - Removed print from io test. [kreczko]
        - Fixed pep8 errors. [kreczko]
        - Parametrised IO tests. [kreczko]
        - Switched "make test" from py.test to pytest. [kreczko]
        - Fixed test samples. [kreczko]
        - Added compare and vis packages to setup.py. [kreczko]
        - Moved draw_diff to vis.draw_diff. [kreczko]
        - _compare_mctruth --> _compare. [kreczko]
        - Moved _diff and _isOK to compare.difference & compare.is_ok. [kreczko]
        - Moved store_diff to io.save_array_to_file. [kreczko]
        - Moved walk function into skvalidate.io. [kreczko]
        - Added folder creation to validation step. [kreczko]
        - Added installation to validation step in CI. [kreczko]
        - Added six to substitute xrange. [kreczko]
        - Fixed pep8. [kreczko]
        - Added validation step to CI. [kreczko]
        - Added test samples & generation script. [kreczko]
        - Added auto-generated docs. [kreczko]
        
        0.0.3
        ------------
        - Fix package description and align versions in __init__.py and
          setup.cfg. [kreczko]
        - Fixed pep8 errors. [kreczko]
        - Added get_artifact_url. [kreczko]
        - Added folder for static docs content. [kreczko]
        - Added root_diff draft. [kreczko]
        - Added remove_from_env command. [kreczko]
        - Updated documentation for all commands. [kreczko]
        - Fixed indentation in README. [kreczko]
        - Expanded on the features of scikit-validate. [Lukasz Kreczko]
        - Renaming CLI class. [Lukasz Kreczko]
        - Rename to scikit-validate. [Lukasz Kreczko]
        - Added missing variable to setup.py. [kreczko]
        
        0.0.2
        ------------
        - Added version lookup in setup.py from lz_validation. [kreczko]
        - CI: simplyfied twine upload to pypi. [kreczko]
        - Fixed behaviour of get_target_branch for non-MR branches. [kreczko]
        - Added explitcit user and pw parameters for twine (upload_to_pypi.sh)
          [kreczko]
        - Fixed comment in upload_to_pypi.sh. [kreczko]
        - Fixed package distribution (was missing commands and io modules)
          [kreczko]
        - Moved pypi upload into separate script. [kreczko]
        - Fixed pypi deployment procedure. [kreczko]
        - Fix gitlab-ci.yml. [kreczko]
        - Added pypi upload. [kreczko]
        - Updated failing test. [kreczko]
        - Fixed linter errors. [kreczko]
        - Moved linting to quick-checks stage. [kreczko]
        - Added artifacts for build stage. [kreczko]
        - Added gitlab-ci.yml. [kreczko]
        - Added more tox setups. [kreczko]
        - Added add_file_metrics command. [kreczko]
        - Added general save_metrics_to_file to lz_validation.io. [kreczko]
        - Added command to merge JSON files. [kreczko]
        - Added script to run clang-tidy. [kreczko]
        - Added execute_with_metrics command. [kreczko]
        - Added command structure and get_target_branch command. [kreczko]
        - Initial commit. [kreczko]
        
Keywords: skvalidate
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
