The History of Data Science

I got an opportunity to talk about this topic two weeks ago in SOTEDx - an internal TED inspired talk in HP Singapore. Just thought it would be good to write it as an article and hence you are here.
Whenever I come across something trending, I generally go back to history to see how it evolved. By looking at history, it helps me to demystify the trend and think logically. I did the same for Data Science to understand what events in history directly/indirectly influenced it to become pervasive in the business world today.

Broadly, there have been people from two schools of thought - the industry, business and corporate on one side and the engineers, computer hobbyists and academia on the other.

In 1955, in the midst of the second industrial revolution, Taylorism or Scientific Management was extensively adopted in industries. Through his theory, Taylor demonstrated that if a process workflow is analyzed and data is collected from all variables involved in the process we can improve over time to achieve economic efficiency. Around the same time, computers and AI were researched a lot after World War II as they played a crucial role in curtailing the war; thanks to Alan Turing and his computer that broke Enigma.

1965s was the time HP developed world's first desktop computer and on the corporate side, Peter Drucker introduced the concept of 'Knowledge Management'. Drucker's theory mentioned that people who think for a living - the accountants, consultants and scientists are the most important resources for any organization.

75s was the time academia realized the importance of data analysis, exploration and visualization thanks to the statistician John Tukey and his book titled 'Exploratory Data Analysis'. While on the industry front, building on the principles of Taylorism, the principle of Kaizen was adopted by Toyota Production System that yielded continuous quality improvement and gained a lot of traction across manufacturing landscape. 

Operating systems debuted in 1985 after personal computers grew leaps and bounds over the past decade. This was also the first time corporate folks started embracing software like Excel and Word. A few of the traditional businesses started to get digitized during this decade.

Internet was born in 1995 and it was the crucial invention that influenced Data Science we have today. Internet was such a gamechanger that businesses and computer folks started to work together.

At the start of the millennium, dot-com companies started to proliferate around the internet. Almost every type of business from florists to restaurants had an online service and it was like a gold rush. A lot of these companies also went public quickly with skyrocketing valuations that led to the dot-com bubble which did burst in a hurry.

By 2005, with a decade of the internet, things had stabilized and the companies like Amazon and Netflix that had survived the dot-com scare were focused on expanding their user base. Google and Facebook also made an entry during this decade. Since all these businesses were entirely digital, they were also able to collect data and tune their services to 'exactly' meet the customers' needs. Jeff Bezos calls it 'Customer Obsession'.

In the next five years, with the introduction of smartphones the concept of 'customer obsession' only intensified. Businesses were able to seamlessly track and target customers for specific services. Desktops put a digital device in every household whereas smartphones made it possible to track every person with his digital footprints.

This further paved the way for on-demand companies like Uber, Airbnb, Deliveroo etc., where a consumer demand is fulfilled in a 'digital' marketplace. These companies also collected tonnes of data through smartphone app services to better understand the customer and to provide him/her with the best services.

By 2015, so much data was generated from digital devices that it necessitated the need for large-scale data analysis. Machine learning algorithms had significantly evolved by now and GPU Processing made AI operational.

So, this is how the Data Science that we have today, evolved. As you may observe, data science or 'learning from data' is not something 'new' and has been around for many decades but in different flavours. The seed for this idea was laid by Friedrick Taylor's scientific management theory. When companies today track their customer or employees to improve their service offerings, a few attribute this as 'Digital Taylorism'. Only the terminologies used has changed over decades (or will change) but the methodology of improving through data will prevail. Hence, it's not the time to fear about data science taking over but to embrace it as it will touch every aspect of our lives and will impact every decision we make in the future.

Last but not the least, thanks to HP for creating SOTEDx that provided a forum to share my thoughts.

Ram Thilak


  1. I would highly appreciate if you guide me through this. Thanks for the article…
    Nice One...
    For Tamil News Visit.. |

  2. I know this if off topic but I'm looking into starting my own blog and was wondering what all is required to get setup? I'm assuming having a blog like yours would cost a pretty penny? I'm not very web smart so I'm not 100% positive. Any recommendations or advice would be greatly appreciated. Cheersshopify sg

  3. You could certainly see your skills in the work you write. The world hopes for more passionate writers like you who aren't afraid to say how they believe. Always go after your heart.physics tutor singapore


  4. This design is wicked! You most certainly know how to keep a reader entertained. Between your wit and your videos, I was almost moved to start my own blog (well, almost...HaHa!) Wonderful job. I really enjoyed what you had to say, and more than that, how you presented it. Too cool!
    Sec 1 maths tuition

  5. Hello There. I found your blog using msn. This is a very well written article. I will be sure to bookmark it and come back to read more of your useful information. Thanks for the post. I’ll certainly return. payday loan singapore

  6. I've been absent for some time, but now I remember why I used to love this blog. Thank you, I’ll try and check back more often. How frequently you update your web site? brand leadership

  7. I'm really loving the theme/design of your site. Do you ever run into any internet browser compatibility issues? A couple of my blog visitors have complained about my blog not operating correctly in Explorer but looks great in Chrome. Do you have any recommendations to help fix this issue? outdoor led signs

  8. Hey just wanted to give you a brief heads up and let you know a few of the images aren't loading properly. I'm not sure why but I think its a linking issue. I've tried it in two different browsers and both show the same outcome. corporate website design

  9. Attractive section of content. I just stumbled upon your web site and in accession capital to assert that I acquire actually enjoyed account your blog posts. Anyway I’ll be subscribing to your augment and even I achievement you access consistently quickly. seo consultant

  10. Their artwork is to help human beings to start export import organization.Please meet the officers for all that u might desire to do for a effective organization. solid success.

    singapore domain registrar

  11. Hello there! Would you mind if I share your blog with my zynga group? There's a lot of folks that I think would really enjoy your content. Please let me know. Thanks
    ladies leather backpack

  12. This is the age of technology and information. With little information anyone can do so much better. Digital marketing makes possible to businesses to come out from traditional practices of marketing and try new and innovative techniques to grow faster.

    pay per click digital marketing

  13. That is really interesting, You are an overly professional blogger. I have joined your feed and look ahead to in search of extra of your magnificent post. Additionally, I've shared your website in my social networks! help restaurant beat competition

  14. dont get a stupid picture or words that mean nothing and just seem cool at the time, like a panther or dumb superman thing.

    includes free delivery within Singapore

  15. I'm not sure why but this website is loading incredibly slow for me. Is anyone else having this problem or is it a problem on my end? I'll check back later on and see if the problem still exists.
    magazine printing near me

  16. I've been browsing online more than 3 hours today, yet I never found any interesting article like yours. It’s pretty worth enough for me. Personally, if all webmasters and bloggers made good content as you did, the net will be much more useful than ever before.
    travel insurance singapore

  17. I must show appreciation to the writer just for rescuing me from this particular setting. Right after searching through the world wide web and meeting solutions which were not helpful, I was thinking my entire life was done. Living devoid of the strategies to the issues you've fixed by way of the article is a critical case, as well as ones which could have adversely affected my entire career if I had not encountered your website. Your own capability and kindness in touching all areas was excellent. I'm not sure what I would've done if I had not encountered such a step like this. I can also at this moment look forward to my future. Thanks for your time very much for the high quality and result oriented guide. I won't be reluctant to recommend your web blog to any individual who needs to have guide on this situation. online marketing singapore

  18. Youre so cool! I dont suppose Ive learn anything like this before. So good to find anyone with some authentic ideas on this subject. realy thank you for beginning this up. this website is one thing that is needed on the internet, somebody with a bit originality. helpful job for bringing something new to the web! ecommerce web design singapore

  19. Being a disruptive technology Big Data Analytics has inspired and directed many enterprises to not only take informed decision but also help them with decoding information, identifying and understanding patterns, analytics, calculation, statistics and logistics. data science course in hyderabad

  20. I see the superlative contents on your blogs. we provide high quality led signs at affordable prices. for more info visit our website.

  21. Thanks for sharing this, I actually appreciate you taking the time to share with everybody.
    Data Science Training In Hyderabad

  22. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.

    best data science courses in chennai

  23. Machine Learning Projects for Final Year machine learning projects for final year

    Deep Learning Projects assist final year students with improving your applied Deep Learning skills rapidly while allowing you to investigate an intriguing point. Furthermore, you can include Deep Learning projects for final year into your portfolio, making it simpler to get a vocation, discover cool profession openings, and Deep Learning Projects for Final Year even arrange a more significant compensation.

    Python Training in Chennai Python Training in Chennai Angular Training Project Centers in Chennai


  24. Excellent blog article. Time for government and political leaders to wake up and take decisive action on tobacco taxes.
    data analytics services companies

  25. Nice post. I was checking this blog and I am impressed! Extremely helpful information specially the last part I care for such info a lot. I was seeking this particular information for a very long time. Thank you and good luck.
    customer data platform

  26. Enjoyed reading the article above, really explains everything in detail, the article is very interesting and effective.

    Python Training Institute in South Delhi

  27. Nice post. I was checking this blog and I am impressed! Extremely helpful information specially the last part I care for such info a lot.

    python training course in delhi
    python training Institute in delhi

  28. This is an awesome post.Really very informative and creative contents. These concept is a good way to enhance the knowledge.I like it and help me to development very well.Thank you for this brief explanation and very nice information.Well, got a good knowledge.
    Cloud Business Management Software Suite

  29. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!

    Python training course in Delhi

  30. Nice post. It is very informative and creative contents which enchance the knowledge. I bookmarmed it and waiting for new articles. Thanks.
    data analysis training course london

  31. This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here keep up the good work palottery

  32. Excellent and very cool idea and great content of different kinds of the valuable information’s.
    Data Sciences Training in Hyderabad


Post a comment

Popular posts from this blog

Indian Ethnic Men’s Clothing – Why every man should have one!!

Comparision between Indian Education Framework and Australian Education Framework

U for Umbrella! #AtoZChallenge2016 #Singapore