Parallelization and profiling#
Scientific computing workflows are often embarrassingly parallel, and yet it can be hard to do in practice. With Sciris, you can do
sc.parallelize(my_func, 10) to run your function 10 times.
It’s also often hard to know where your code is being slow. While there are great tools like Austin for deep dives into performance, you can use
sc.profile(my_func) for a quick glance – which is often all you need.
Functions to allow parallelization to be performed easily.
Profiling and CPU/memory management functions.