Blog | luminousmen

I P
Back

Spark. Anatomy of Spark application

Apache Spark is considered as a powerful complement to Hadoop, big data’s original technology. Spark is a more accessible, powerful and capable big data tool for tackling various big data challenges. It has become mainstream and the most in-demand big data framework across all major industries....

Spark core concepts explained

Apache Spark is considered as a powerful complement to Hadoop, big data’s original technology. Spark is a more accessible, powerful and capable big data tool for tackling various big data challenges. It has become mainstream and the most in-demand big data framework across all major industries....

Best blogs/podcasts to follow for Python developers

I want to share blogs and podcasts I occasionally read/hear stuff from. Python subreddit First things first. This is a good feed for any Python related news. Dev.to This is a great source of information for beginners and I really love the community around this resource. Ned Batchelder blog This...

Asynchronous programming. Python3.5+

This is a practical post of the series of asynchronous programming. Whole series: Asynchronous programming. Blocking I/O and non-blocking I/O Asynchronous programming. Cooperative multitasking Asynchronous programming. Await the Future Asynchronous programming. Python3.5+ In this post, we will...

__context__ vs __cause__ attributes in exception handling

Since Python 3.0, raising an exception in an except block will automatically add the caught exception in the __context__ attribute of the new one. That will cause both exceptions to be printed. Essentially this is a way for the current exception to carry information about the previous exception....

Resolve cython and numpy dependencies on setup step

I have a custom Python package on my project where some functionality implemented on Cython. We use it to speed up some of the slowest parts of our code - the syntax is pretty close (it can be identical except some imports) to regular Python. Cython compiled to .so libraries and it has support...