Metadata-Version: 2.1
Name: FireSpark
Version: 0.0.25
Summary: FireSpark data processing utility library
Home-page: https://elc-github.magna.global/Magna-Autonomous-Systems/FireSpark
Author: Hai Yu
Author-email: hai.yu1@magna.com
License: Apache License 2.0
Description: FireSpark
        =========
        
        FireSpark aims to provide Magna ML/MAS team a flexible and standardized library supporting data processing, management, dataset curation, and ETL related activities. 
        
        A dataset created using FireSpark is stored in [Apache Parquet](https://parquet.apache.org/) format. On top of a Parquet
        schema, FireSpark takes advantage of open source [Petastorm](https://github.com/uber/petastorm) library to support multidimensional arrays. 
        
        **This repo is at its early phase development stage. Please contact [me](hai.yu1@magna.com) if you have question, especially on contributing use case specification, requirements, suggestions.** :innocent:
        
        
        
        
Keywords: dataset processing
Platform: UNKNOWN
Classifier: Environment :: Console
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Description-Content-Type: text/markdown
Provides-Extra: opencv
Provides-Extra: tf
Provides-Extra: tf_gpu
Provides-Extra: tf_datasets
Provides-Extra: imgaug
Provides-Extra: test
Provides-Extra: torch
