Organised by:
in collaboration with:



social media:


Accesso Utenti

European Organisation for Astronomical Research in the Southern Hemisphere (ESO)
Miscellaneous Information:

Abstract Reference: 30567
Identifier: P6.11
Presentation: Poster presentation
Key Theme: 6 Python in Astronomy

Python code parallelization, challenges and alternatives (lightning talk)

Gonzalez Justo, Taylor Julian, Castro Sandra, Kern Jeff, Knudstrup Jens, Zampieri Stefano, Alisdair Manning, Bhatnagar Sanjay, Rao Urvashi, Golap Kumar, Nakazato Takeshi, Sugimoto Kanako

In the last few years development of Python code for science and data reduction purposes has gained significant popularity. ESO in itself uses a Python-based archiving  system for VLT and ALMA data. Also the data reduction suite for ALMA data is python-based. Rapid development is fostered by a big community and a wide range of already available packages. However Python enforces locking mechanisms, to ensure thread safety, that effectively reduce the capacity of Python to use only one core. In this context a number of alternatives have been developed by the community to emulate actual multi-threading and make parallel processing easier to use from Python, preserving interactivity.