Do It Yourself Data Analysis for Electoral Bonds


Electoral Bonds is my favorite hot topic these days and I have been following developments on this issue with keen interest. Early in March when Supreme Court asked SBI to provide the information about who donated to whom, SBI asked more than three months’ extra time to furnish the required details. It said that 22 thousand bonds had been issued to various political parties between April 2019 and February 15 this year and the data about the issued and redeemed bonds was in two silos. It needs time to correlate the information from these two silos.

However, the Supreme Court insisted that SBI releases the data in two separate silos as it is, without trying to correlate it. After a little push from SC, SBI finally provided this Electoral Bond data to EC yesterday and it was published as two PDFs on EC website:

  • Bonds Issue details - 386 Pages
  • Bonds Redemption details -  551 Pages

Anyone interested in Data analysis will be tempted by these large data sets to try this challenging exercise with a goal to determine who donated how much and to which party. 

I also tried my hand at it in Microsoft Excel with the following steps:

1. Process the Bonds Issue details PDF

  • Load the data from the PDF file in a table in PowerQuery. 
  • Each bond has a Prefix (eg TL) and a Bond Number (eg 11448). Create unique Bond id for each bond by combining these two columns.  eg TL-11448.
  • Keep only the following columns in the Bonds Issue table, removing the rest:
    • Bond id
    • Name of the Purchaser
    • Date of Purchase
    • Denominations

2. Process the Bonds Redemption details PDF

  • Load the data from the PDF file in a table in PowerQuery. 
  • Each bond has a Prefix (eg TL) and a Bond Number (eg 11448). Create unique Bond id for each bond by combining these two columns.  eg TL-11448.
  • Keep only the following columns in the Bonds Redemption Table, removing the rest:
    • Bond id
    • Name of the Political Party
    • Date of Encashment
    • Denominations

3. Merge the two Tables

Merge Bonds Redemption Table and Bonds Issue table with unique Bond id field. With this, you get a table with the following columns:

  • Bond id
  • Name of the Political Party
  • Date of Encashment
  • Denominations
  • Name of the Purchaser
  • Date of Purchase
  • Issue.Denominations

This table has all the desired information we are looking for. It was really an interesting exercise, and just for record, it took about two hours to complete it. Last night most newspapers did similar exercise and published the results. 

I am still wondering what made SBI overestimate the effort involved by such a large factor.



The Daily Habit: Master Any Skill by Spending Time Every Day

 Very often I have experienced that when I pick up a new song for singing, it feels very difficult in the beginning, too high notes, of too fast pace, or no breathing space etc; however, if I spend a few minutes singing it every day, it gets manageable gradually, the hurdles slowly disappear, and in a few days, it starts to feel easy to sing it. 

I think there is an important learning here that can be applied to mastering any skill, whether it's learning a new language, mastering a musical instrument, or honing a professional skill, the key lies in dedicating time to practice it every single day. This is not just a theoretical principle; it's a tried and tested formula that I have seen working in multiple endeavors.

How does it work? Think of a sculptor chiseling away at a block of marble or a pianist practicing scales. At first glance, progress may seem incremental, but over time, these small, consistent efforts compound to produce remarkable results. I guess doing something every day ingrains the skill into our muscle memory, making it second nature. This is how it transforms difficult tasks into habits and routines.

For sure, the path to mastery and accomplishment is not going to be straightforward. There will be days when you will experience hurdles, setbacks, frustrations, and plateaus along the way. However, by focusing on the process rather than the end goal, we learn to embrace the journey. Enjoy each practice session and see it as an opportunity for growth, a chance to push past our limits and expand our capabilities. 

In today’s world of instant gratification, the idea of daily practice may seem too slow and impractical. However, mastering any skill is a marathon, not a sprint. It requires patience, dedication, and, above all, a willingness to put in the required effort. So, whether you're aspiring to become a singer, a proficient coder, or a fluent speaker, remember: the journey to mastery begins with a commitment to spend time on it on a daily basis.


How to Survive in Today's Fast-Changing World

 


A lot of what I learned in my Electronics engineering course at Roorkee became inadequate in next few years. Then I went to IIT Bombay to refresh my knowledge with an M. Tech course, but this was also useful only for a decade or so. I had to master very different skills and technology in the second half of my career. Gradually, I realized that in such rapidly evolving scenario, the only constant is change itself.

Today, the pace of  technological advancements and social shifts is even faster than what I went through. You run the risk of losing relevance if you do not master the art of negotiating these changes successfully. I can say from my experience that the key to survival lies in our ability to adapt and evolve continuously to stay ahead of the curve. Let's look into the secrets of thriving amidst uncertainty and rapid change. 

Accept Change

Change in inevitable, so we should anticipate it, accept it and embrace it wholeheartedly. Rather than resisting or fearing change, let us see change as a chance for growth and innovation. Remember that change brings with it new possibilities, challenges, and avenues for exploration. If you adopt a mindset of flexibility and resilience, you can navigate through transitions with greater ease and confidence.

Continue to Learn and Evolve

All knowledge and skills have the risk of becoming obsolete at an alarming rate today. To prepare for it, you should make learning a lifelong habit and invest time to acquire new skills, knowledge, and competencies regularly. It may be through formal classes, online courses, or hands-on experience, look for opportunities to expand your horizons and stay updated with the latest developments in your field. The time you spend in this learning process will make you better equipped to face the uncertainties of tomorrow.

Be Flexible

In a forest, the trees that are flexible have better chances of survival during a storm, Flexibility is the cornerstone of survival in a fast-changing world. Rigidity and inflexibility can hinder progress and leave you vulnerable to being left behind. Cultivate a mindset of flexibility and adaptability, willing to pivot and adjust course when necessary. As an example, if there is a change in your role at job, be willing to accept the change with open mind. Remain open to new ideas, perspectives, and ways of doing things. By being flexible in your approach, you can quickly respond to changing circumstances and seize emerging opportunities.

Innovation

Innovation is a key skill needed today above everything else. Stay curious and creative, constantly seeking out new ways to innovate and improve. Whether it's finding more efficient processes, developing groundbreaking technologies, or pioneering novel solutions to complex problems, innovation is key to staying relevant today. Encourage a culture of innovation within your team, fostering collaboration, exploration, and out-of-the-box thinking.

Build Resilience

Resilience is the ability to bounce back from setbacks and failures and emerge stronger. In an uncertain and volatile situation, resilience is a crucial trait for survival. Develop resilience by maintaining a positive outlook in the face of adversity, learning coping mechanisms, and building a strong support network of family, friends, and mentors. You may hit a roadblock or a setback, but every setback may be an opportunity for growth and learning, and a resilient mindset will help carry you through the toughest of times.

Things that do not Change with Time

Surviving in an ever-changing world requires a combination of adaptability, continuous learning, flexibility, innovation, and resilience. The secret to survival lies not in resisting change, but in embracing it and using it as a catalyst for growth and transformation.

In the midst of these changes, are there things or skills worth learning that do not become obsolete with time? Yes, these are the fundamental principles that have endured through the ages and have remained unchanged. Examples are hard work, taking responsibility for your life, time management, invest in self-development, empathy, working with others, etc. Take time to master these principles as these will help you evolve to face the challenges of future.