Posts

Spark learning journey - Part 1

Image
I need to start getting accommodated with Spark .This is both because I will need it in my new project but also because it is quite a successful platform these days and those of us working in data related projects need to know the bits and pieces of cluster  processing systems. I'll start a series of notes from my learning curve, this is the first post. I hope some of you who are new to this platform will find them useful, so i'll write them for beginners, simply as my notes. First thing you should try to get an overall understanding of what is Spark and what are the industry problems it solves. Among many very good documentation I browsed online, I would say this   link provides a good overview summary that is easy to read and understand. Step 1- Document yourself  For documenting, first thing I started to do is reading the book   Big Data SMACK: A Guide to Apache Spark, Mesos, Akka, Cassandra, and Kafka  by Raul Estrada (Author), Isaac Ru...

Happy Programmer's day - 13 September 2018

Image
Happy all programmer's day! Today is the 256th day of year 2018, that is the International Programmer's day ! The Day of the Programmer is an international professional day that is celebrated on the 256th day of each year (September 13 during common years and on September 12 in leap years). The number 256 was chosen because it is the number of distinct values that can be represented with an eight-bit byte. Computers,IOT, evolving technology and software make the world go around,but behind every piece of software stand teams of programmers,solving complex problems with code, algorithms, security solutions, streaming platforms and data processing techniques. For this special day, please enjoy reading a list of Romanian software engineers who have been either pioneers in this field or contributors to famous projects in the industry. Spark, Messos and Hadoop Matei Zaharia is a Romanian-Canadian computer scientist specializing in big data, distributed systems, and...

OpenGrok review - why and how to use it in a large team

When working in large software companies, it is common that you end up working at some point for a large project with a business logic history that is never well documented. You find it hard to know what features are available in the existing project, which component triggers a specific behavior or if  the system processes some specific information you need to learn more about. This is particularly frustrating in migration projects from an old platform to a new one, especial when the initial engineers are no longer with the company or have reduced their number. While this is not a very big issue for developers given the codebase is usually their documentation, it might be an issue for business analysts or other functions who do not have the habit to browse through the codebase using professional tools. Luckily nowadays there are a lot of  source code web browsers, that offer the search capability in a web interface for references in the codebase.  The source code...

I Take Unconference 2018 Highlights

Image
I Take Unconference   is a great community event organised in Bucharest by MosaicWorks , that brings together international speakers, experienced developers and other software professionals to share knowledge around subjects which usually go beyond coding and programming languages - it usually covers systems integration, devops and software architecture and design. All speakers were absolutely great, the atmosphere is  exactly the one of a professional community, the organizers do a great job at creating space and context for knowledge sharing - see the Open Space, the Kata Lounge or Code with a Stranger. We got to meet peers from other companies, but also spend time after keynotes with the speakers. Here are some of my highlights - happy to see summaries of other participants as well. Day one was opened by famous Michael Feathers . It is the second time when the author of Working Effectively with Legacy  Code was present at this conference. He was al...
Hello world! Happy to start a new blog! This will be about software and IT today -  personal notes taken when playing with new tools,frameworks or apps, in the process of keeping updated on how software industry evolves. Cheers,