Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
227 views
in Technique[技术] by (71.8m points)

python - how to run Dask pypy

I am new to the Dask framework, therefore, kindly forgive me if my question sounds silly to you.

Currently, I am using Dask-distributed (2020.12.0 from conda) to run my task in LocalCluster, which is quite fast, but my concern is related to the pypy support with Dask. As I saw the GitHub blog by @mrocklin where it is stated that if we use pypy to run Dask scheduler than we can get a speedup of around 2X-5X. But my concern is how to register Dask-scheduler to use pypy. I also visited the Dak documentation?but not able to find the?required solution. Currently, I created a conda environment with pypy (Blog), but not able to use pypy with Dask.? ??

if there is some script or modification required to register scheduler (as we write to for cython), kindly let me know.

Kindly advise me in this?regard, any help will be highly appreciated.

question from:https://stackoverflow.com/questions/65951356/how-to-run-dask-pypy

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Reply

0 votes
by (71.8m points)
Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
OGeek|极客中国-欢迎来到极客的世界,一个免费开放的程序员编程交流平台!开放,进步,分享!让技术改变生活,让极客改变未来! Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...