Split and conquer9/10/2023 ![]() ![]() Since there are 4 clear steps, do we need to rerun the whole process in case of failure?Īs we supposed, after some digging with the customer, we found out that there were different actors for each part of the process.Could it be that different persons must be informed depending on the type of error and their role?.Who are the stakeholders of each part of the process?.Using a serverless approach seemed a good idea in order to make this process scale as needed, but is that enough? To make things even harder, we also needed to consider the possibility of running multiple processes at the same time, since a bunch of zips must be populated initially (about 800 zips processed at the same time). Populating an index to enable a fast searching engine.Generating the newspapers images to be consumed.Downloading, extracting and analyzing the information inside the zip file.This process of analyzing and populating the XML hierarchy inside the zip file was complex, error-prone and time-consuming. On a daily basis a content team was responsible for the digitalization of all the edition’s articles, images, pages, position within a page where an article is placed and much more.Īll this information, internally mapped as an XML hierarchy, was packed in a huge zip file that after being processed could be consumed by many other applications, such as a PDF viewer app for mobile phones. In a recent project for a well known Italian newspaper, we were in the need to refactor a process in charge of analyzing and populating all the information of the newspaper edition. ![]() ![]() In this strategy, one power breaks another power into smaller, more manageable pieces, and then takes control of those one by one. In fact, it is often applied in the arenas of politics, sociology and psychology. This can also be extrapolated to the concept of trying to split a big problem into smaller, more manageable and easy to tackle tasks when you are analyzing your product backlog. Anyone who studied algorithms might be familiar with the concept of divide and conquer whereby splitting a problem and resolving a small set (recursively) and afterwards combining the result of all the pieces, a big, difficult task can be easily solved. ![]()
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |