Blog | luminousmen

Back

Spark. Anatomy of Spark application

Apache Spark is considered as a powerful complement to Hadoop, big data’s original technology. Spark is a more accessible, powerful and capable big data tool for tackling various big data challenges. It has become mainstream and the most in-demand big data framework across all major industries....

Spark core concepts explained

Apache Spark is considered as a powerful complement to Hadoop, big data’s original technology. Spark is a more accessible, powerful and capable big data tool for tackling various big data challenges. It has become mainstream and the most in-demand big data framework across all major industries....

Best blogs/podcasts to follow for Python developers

I want to share blogs and podcasts that I occasionally read and listen to. Python subreddit This is a good news feed for any news related to Python. Dev.to This is a great source of information for beginners and I really like the community around this resource. Low signal-to-noise ratio. Ned...

Asynchronous programming. Python3.5+

This is the forth post in a series on asynchronous programming. The whole series tries to answer a simple question: "What is asynchrony?". In the beginning, when I first started digging into the question, I thought I knew what it is. It turned out that I didn't know the slightest thing about...

__context__ vs __cause__ attributes in exception handling

As of Python 3.0, raising an exception in the except block will automatically add the captured exception to the __context__ attribute of the new exception. This will result in a printout of both exceptions. Essentially, this is the way the current exception will carry information about the...

Resolve cython and numpy dependencies on setup step

In my project, I have a custom Python package that has part of its functionality implemented on Cython. We use it to accelerate some of the slowest parts of our code — the syntax is pretty close to regular Python (it can be absolutely identical except for some imports). Cython compiled with .so...

Optional arguments MUST use keywords (Python3)

Imagine that you are developing software for a large shipping company (why not imagine a small company). And you have the task of creating a function for calculating fees for ships based on their cargo weight. Easy peasy: WEIGHT_RATES = [ ( 10, 10.55), ( 5, 5.05), ( 2, 3.35), ( 0, 1.25) ] def...

Python interview questions. Part III. Senior

I am starting a series of posts about my own base of interviewing questions. Of course, it is not full and it doesn't have any answers and maybe some of the questions seem weird or even stupid, but I think they are good for finding the right candidate for Python position. Python interview...

Python interview questions. Part II. Middle

I am starting a series of posts about my own base of interviewing questions. Of course, it is not full and it doesn't have any answers and maybe some of the questions seem weird or even stupid, but I think they are good for finding the right candidate for Python position. Python interview...

Python interview questions. Part I. Junior

I am starting a series of posts about my own base of interviewing questions. Of course, it is not full and it doesn't have any answers and maybe some of the questions seem weird or even stupid, but I think they are good for finding the right candidate for Python position. Python interview...