veyepar: Parallelism in Python

Author(s):	Rounak Vyas
Location	Auditorium 2
Date	aug Sat 24	Days Raw Files
Start	11:50	First Raw Start	11:34
Duration	00:50:00	Offset	0:15:15
End	12:40	Last Raw End	12:34
Chapters	00:00 0:01:27 0:15:22
Total cuts_time	17 min.

raw-playlist raw-mp4-playlist encoded-files-playlist host tweet mp4 svg png

assets release.pdf parallelism_python.json
logs
Admin: episode episode list cut list raw files day marks day marks day image_files

State:

Locked:

clear this to unlock

Locked by:

user/process that locked.

Start:

initially scheduled time from master, adjusted to match reality

Duration:

length in hh:mm:ss

Name:

Video Title (shows in video search results)

Emails:

email(s) of the presenter(s)

Released:

has someone authorised pubication

Normalise:

Channelcopy:

m=mono, 01=copy left to right, 10=right to left, 00=ignore.

Thumbnail:

filename.png

Description:

markdown

Python as a language has enjoyed a decade of usage in both industry and academia. It has been the most popular abstractions to scientific computing and machine learning, yet the base remains single-threaded. Just how is productivity in these fields being maintained with a single-threaded language?

"Python has a terrible reputation when it comes to its parallel processing capabilities. Ignoring the standard arguments about its threads and the GIL (which are mostly valid), the real problem with parallelism in Python isn't a technical one, but a pedagogical one. The common tutorials surrounding Threading and Multiprocessing in Python, while generally excellent, are pretty “heavy.” They start in the intense stuff and stop before they get to the really good, day-to-day useful parts.

The talk will highlight the impact of Global Interpreter Lock on multithreaded programs and include code snippets to compare single and multithreaded programs using a real life example. Then, we move on to the concept of multiprocessing and the address its benefits over multithreading and mention some examples for it. The talk will end with an application of multiprocessing in the area of Computer Vision and how it speeds up the completion of a task by 82%.

Moreover this talks aims to inspire both novices and experts to look more into this subject and create something that could possibly be of benefit to the entire python community around the world."

My name is Rounak Vyas, I’m currently a junior at SRM University Chennai, India. I’m majoring in Information Technology. I’m a student researcher at Next Tech Lab and also a member of the Artificial Intelligence Research Team in the Association of Computing Machinery - SRM Chapter. My area of research involves working with computer vision models and multi-agent reinforcement learning, I’ve been a speaker at two Tech conferences in India: PyData KTR and ChennaiPy, talking about the parallel processing capabilities of python.

Comment:

production notes