Blog | luminousmen

I P
Back

Spark core concepts explained

Apache Spark is considered as a powerful complement to Hadoop, big data’s original technology. Spark is a more accessible, powerful and capable big data tool for tackling various big data challenges. It has become mainstream and the most in-demand big data framework across all major industries....

Best blogs/podcasts to follow for Python developers

I want to share blogs and podcasts I occasionally read/hear stuff from. Python subreddit First things first. This is a good feed for any Python related news. Dev.to This is a great source of information for beginners and I really love the community around this resource. Ned Batchelder blog This...

Asynchronous programming. Python3.5+

This is a practical post of the series of asynchronous programming. Whole series: Asynchronous programming. Blocking I/O and non-blocking I/O Asynchronous programming. Cooperative multitasking Asynchronous programming. Await the Future Asynchronous programming. Python3.5+ In this post, we will...

__context__ vs __cause__ attributes in exception handling

Since Python 3.0, raising an exception in an except block will automatically add the caught exception in the __context__ attribute of the new one. That will cause both exceptions to be printed. Essentially this is a way for the current exception to carry information about the previous exception....

Resolve cython and numpy dependencies on setup step

I have a custom Python package on my project where some functionality implemented on Cython. We use it to speed up some of the slowest parts of our code - the syntax is pretty close (it can be identical except some imports) to regular Python. Cython compiled to .so libraries and it has support...

Optional arguments MUST use keywords (Python3)

Imagine that you are developing software for the big shipping company(why would you imagine small anyway). And you got a task to create a function for calculating a charge for ships based on their cargo weight. Easy breezy: WEIGHT_RATES = [ ( 10, 10.55), ( 5, 5.05), ( 2, 3.35), ( 0, 1.25) ] def...