在线时间:8:00-16:00
迪恩网络APP
随时随地掌握行业动态
扫描二维码
关注迪恩网络微信公众号
开源软件名称:ploomber/soorgeon开源软件地址:https://github.com/ploomber/soorgeon开源编程语言:Python 100.0%开源软件介绍:SoorgeonJoin our community | Newsletter | Contact us | Blog | Website | YouTube Convert monolithic Jupyter notebooks into Ploomber pipelines. soorgeon.mp4Try the interactive demo: Note: Soorgeon is in alpha, help us make it better. InstallCompatible with Python 3.7 and higher. pip install soorgeon UsageTesting if the notebook runs (Optional)Before refactoring, you can optionally test if the original notebook or script runs without exceptions:
or
Refactoring# refactor notebook
soorgeon refactor nb.ipynb
# all variables with the df prefix are stored in csv files
soorgeon refactor nb.ipynb --df-format csv
# all variables with the df prefix are stored in parquet files
soorgeon refactor nb.ipynb --df-format parquet
# store task output in 'some-directory' (if missing, this defaults to 'output')
soorgeon refactor nb.ipynb --product-prefix some-directory
# generate tasks in .py format
soorgeon refactor nb.ipynb --file-format py
# use alternative serializer (cloudpickle or dill) if notebook
# contains variables that cannot be serialized using pickle
soorgeon refactor nb.ipynb --serializer cloudpickle
soorgeon refactor nb.ipynb --serializer dill To learn more, check out our guide. CleaningSoorgeon has a
or
Examplesgit clone https://github.com/ploomber/soorgeon Exploratory data analysis notebook: cd soorgeon/examples/exploratory
soorgeon refactor nb.ipynb
# to run the pipeline
pip install -r requirements.txt
ploomber build Machine learning notebook: cd soorgeon/examples/machine-learning
soorgeon refactor nb.ipynb
# to run the pipeline
pip install -r requirements.txt
ploomber build To learn more, check out our guide. Community |
2023-10-27
2022-08-15
2022-08-17
2022-09-23
2022-08-13
请发表评论