Archive for category Other
Staying disconnected from digital media for any period of time is such a challenge these days for most of us.
There is a definitive impact of the Internet on my attention span. I can feel it on an everyday basis. When I am doing research for work, the need to pepper in some wasteful social media and news article reading time is often very strong; to the extent that the inability to have the distraction becomes a burden in itself. Sometimes, I have to force myself to get to the end of a document or article before switching tabs. Honestly, when I force myself to focus in this manner, I find myself having to re-read entire sections of said document or article due to a lack of focus! I often wonder how I would fare if I were tested for attention-deficit-disorder (ADD) now. I am pretty sure attentiveness was not an issue ten years ago in my life but I cannot say that with any conviction today.
I conducted a little experiment back in May 2014. I was going on vacation and I refused to get online for 4 full days. Well- almost not online. Since I was going to be on a Caribbean island and my Indian mother was determined to freak out without daily check-ins, I was offline except for a daily “I’m still alive” text message to her.
The surprising thing about being offline is how much more active your mind can become. You can develop almost a renewed sense of appreciation for the world around you. I have never been a good photographer and I count that as one of the blessings in my life. The camera is, in my opinion, one of the earliest examples of how you can lose out on experiencing the moment in your endeavor to capture it for posterity. I believe that’s true for habits such as using your cell phone to pass the time when you’re standing in line at the grocery store. These mundane situations are rich with possibilities for having serendipitous interactions with other real, live human beings that you may never get to say a word to otherwise. Your mind and body thrive on these interactions. It’s a shame that we don’t indulge these needs more- because our digital crutch has truly made us impaired!
If anything, I hope this article forces you to think about just how dependent you are on electronic media/digital devices. I was going to say electronic approval- but that’s a whole other topic for another day! I will leave you with this link to similar ideas and dicussions on the Scientific American NetLoss: Secintific American Article
“SAP tried to introduce natural language processing based BI tools about five years ago and failed. Why would I use yours?”
Yesterday I was explaining to a customer that the QuickLogix natural language query engine would make it easier for his business users to ask questions and make meaning out of their data. Being the IT Director of a multi-billion dollar company, this was a question I was expecting him to ask and he didn’t disappoint! So why indeed does Gartner project that Natural Language processing is the next big thing in the world of data analytics and business intelligence? Why- if it has been tried before- not 30 years ago- but barely 5 years ago- and it didn’t really take off then?
It boils down to one major tech Trend in the past 10 or so years and one major Event in the past 3 years.
I remember the days when the leading edge of innovation was done in the Enterprise world and the benefits bled into the consumer market. Sometime around the mid 2000s, perhaps with the introduction of the iPhone, that trend started reversing. Consumer products and requirements were on the leading edge of technological creativity. All things new and exciting in the enterprise world (cloud computing, SaaS products etc.) are dictated bleed-outs of the consumer market. More mobile devices meant more data being transferred(volume), more content being generated (variety) and more demand for quick turnaround on data accessibility and processing (velocity). Yes the familiar 3Vs of Big Data are a direct result of demands in the consumer market.
When it comes to natural language processing, I like to think of the world as pre-Siri and post-Siri. Apple introduced Siri to the world with the iPhone4S in October 2011. Ever since, there has been a renewed focus among all other phone OS manufacturers to provide (or improve upon) a similar service. Google has been around a long time with their ground-breaking natural language search. However it is the advent of Siri that has set the average consumer expectation that all interactions- personal or otherwise- can (and should) work by using simple English.
The Trend and the Event together have subliminally revolutionized the mindset of the workforce. More and more business specialists and users are becoming inclined to use natural language in their work. The mobile evolution will serve as a potent catalyst for the acceptance of NLP by business users in their everyday functional tasks. The challenges of training them to ask the right questions and make meaning out of the results will remain. But the adoption of the technology in itself? It was tried in the 1950s & 60s, in the late 1990s and early 2000s- but in this third coming- natural language processing is here to stay.
Here are five important things to know about data lakes:
1. What is a data lake? That’s a good place to start any conversation! A data lake is essentially a landing zone to store all the data that an organization collects. The main advantage over a traditional enterprise data warehouse (EDW) is that there is no need for extract-transform-load (ETL) processes to ingest the data from any operational systems or to access the data from the data lake itself. In addition, it is relatively inexpensive and massively scalable.
2. Traditional EDW systems also have restrictions on the data types that they can support. All enterprise organizations today collect more data than they process. The data lake can be used to store data of any type and in any format. As a result, the cost of transforming herewith inaccessible information (such as text, images and other unstructured data) is eliminated or at least substantially reduced. What this really means for any organization is that new operational systems can be easily added into the data lake and users can start deriving insights from them almost immediately.
3. Why isn’t everyone adopting data lakes? There are a couple of pertinent reasons. To begin with, a lot of organizations have invested heavily in the infrastructure, support and services offered by the large EDW solution providers (IBM, SAP, Oracle, Microsoft) and making a transition needs many levels of business justification. Also, the data lake technology (and the Enterprise Hadoop ecosystem) is new and evolving. As a result, early adopters will only include organizations that want to be on the cutting-edge of technological advances, those that would like to capitalize on the financial advantages of the data lake or those that are willing to hedge their bets on revolutionary solutions offered by up and coming players like QuickLogix (www.quicklogix.com. full disclosure- I am affiliated with this organization).
4. Data governance has been a challenge with EDW systems. It is only going to gain more prominence with the advent of data lakes. Gaps in data quality and reliability will be more easily exposed. We should collectively be applauding this development. IT teams can shift their emphasis from working on ETL processes to move the data into the common store to ensuring that the data collection (operational) systems meet stringent quality standards.
5. Data lakes are not for everyone. One of the common complaints from data architects and technologists is that their organization is simply not suited for a shift to scale-out, parallel, no-SQL systems. It is true. To dig a hole, you might just need a spade not a jackhammer. However, it is important to assess current and future technological requirements of the organization while making these choices.
The best talks I’ve ever heard always had one thing in common- they gave me goose-bumps and made me teary-eyed! The topics have ranged from technology (yes nerd-alert!) to politics- but most recently- it was education. Yesterday I attended the SxSWEdu Education Expo and sat in on a series of presentations. When Sarah Mabry walked on stage, the first thing I noticed was the bold-white frame of the eye-glasses she was sporting and the second thing was her magician-robe styled outfit. When the third sentence in her speech was “Sarah Mabry is not a wizard”, I knew this was going to be interesting! I wasn’t prepared for inspirational. Ms.Mabry was kind enough to share a written copy of her speech with me- but there were lines she uttered that aren’t contained in the text I now possess. Here are some of my favorites from her presentation:
“A nation is ONLY as strong as its educational foundation”
These are powerful words. She did reiterate this line three times. The message they contain is beyond powerful- it carries an urgency that cannot and should not be ignored. From 2008-2013, the United States fell from being #1 amongst 48 countries in its Global Competitiveness Index ranking to #5 (per the World Economic Forum). Let’s not forget that economic strength is valuable political capital.
“We are all stakeholders- so we must all be investors”
Yes this gave me those goosebumps. There is no doubt that our children are our future. Providing them with the resources to do better than we could is a fundamental responsibility that we all shoulder- as adults, parents, teachers and citizens. Unfortunately, the availability of these resources and opportunities appears to be in sync with the socio-economic divide. We know that the profile of the student population is projected to be over 50% non-Anglo American in the next 20 years and we also know that a majority of the disadvantaged youth population belongs to that same demographic bracket. Talk about predictive analytics- this is a pattern staring us in the face- and one we cannot afford to ignore.
“From those who have been given much, much is expected”
Slightly reminiscent of the Spiderman dialogue “With great power comes great responsibility”!! I think Ms.Mabry’s version is clearly a call to action. The challenges that our educational system faces today are not (and never have been) limited to the socially, economically, linguistically deprived sections of society. It’s a national emergency that requires everyone to listen, participate and contribute.
When I meet with customers to explain that the QuickLogix qLSocial product will help them increase customer engagement and keep their fingers on the pulse of customer sentiment, they sit forward and want to know more. Why is this such a big deal for companies now? In the past decade or so, businesses have cumulatively sent consumers into a state of starvation when it comes to individual concerns and complaints. What were we doing wrong?
1. Removing customer service phone numbers from websites: Let’s face it- when you are in a bind, you want to tell someone the problem instead of typing out an email or filling out an online form. The one thing you definitely do not want to do is deal with this next thing…
2. Setting up long winded, automated phone support systems: Possibly the biggest annoyance conjured up by customer service experts in the past decade is the never ending automated response system. Even more so, the ones that won’t let you skip to a human by pressing the number 0 right at the beginning. And when you do press 0, you get in line as a valued customer for what seems like eternity. You have to setup a calendar appointment so you can figure out why there was that unexplained charge on your phone bill!
3. Providing scripts to customer service and sales reps: We have all been on the receiving end of the service representative who appears to simply not understand what you are telling them. I’ll never forget this mortgage company Sales rep who called me one afternoon. I was indeed looking to refinance my home but he would not stop badgering me about what was happening in my personal life that made me want to refinance. I tend to be a private person and I did not appreciate his probing questions and I said as much. He made me feel like I had a mental health issue because I would not confide in him. It occurred to me later that he was simply following his script- he could not give me numbers unless we walked through the questions he had to ask me. It wasn’t entirely his fault- but it’s an example of why profiling customers as a group is just not a smart idea.
4. Placing an unreasonable incentive on short customer service calls: When I worked as a software developer, we once had a manager who decided that measuring performance would be based on the number of issue tickets that people closed. It lead to the incredibly unhealthy and unproductive habit among the team wherein folks would create tickets for misspelt commented text. I think incentivizing customer service reps by the shortness of their calls can be similarly counter-productive.
But in all this time, we have been doing some things right. By moving so many business transactions online, creating customer logins and monitoring web-traffic and behavior- we have been setting the stage for recovering lost ground using big data. For the last decade or more, we have been priming consumers to yearn for a personal touch, a feeling of being understood as an individual and not part of a herd! Engaging with customers is the low hanging fruit on the big data promise tree. You want to at least start there!
DO Be patient: When working with teams for whom English is a second language- it can be frustrating to have to repeat every sentence. However- put yourself in their shoes and remember you’d be struggling if you had to do business in Chinese, Hindi, Russian etc.
DO Be part of *their* team: You can get a lot from even a mediocre team (and the team I was interfacing with was definitely mediocre) if they recognize that you are part of their team. Words like “We”, “our goals”, “our progress”, “our accomplishments”, “our missed deadlines” vs you, “your ” create a team-spirit that is palpable across even a phone line.
DON’T be funny: I remember attending a seminar years ago where a senior engineer from IBM was talking to us about working with overseas teams. She said that nothing could bomb on an inter-cultural team meeting like humor. Humor does NOT transcend boundaries as much as we’d like it to. Get to know the team you are working with and over time, you can inject humor to lighten the mood.
DO be diligent: It’s very important to understand that in Asia- people really respect knowledge (and yes titles). They also assume you are stupid unless proven to be smart (if you have a good title- then you are given a little more room for errors). So be smart. Be intelligent. Don’t fake it. Do your homework. Earn their respect. Only then can you give orders and expect them to be followed.
DO know the goals of the project: Whether you chart the course from the very beginning or make adjustments along the way, have a good feel for what your working strategy is going to be. Be candid with the team about it up front. (If you expect changes to be made- tell them- so they can expect it too). Also- make sure you have a good understanding of what will define a successful project (technical, business, process wise etc). It will influence the energy and performance of the team you are working with greatly.
DO be honest: If you are unsure about something, please be honest with the team about it. If the deadline is creeping up and you are feeling the pressure- share it.
As I was browsing discussions on LinkedIn, I came across a question from Natalia Ostraverkha – COO at Mobidev. She was asking about communication between teams on both sides of an outsourcing project (here). I had to chip in! This is a close-to-my-heart topic. Read on for my comments and let me know if you agree or not!
In my past experience working with overseas teams (outsourcing partners) I found the following things to be very useful:
Working with a remote team is as much about psychology as it is about technology. Also, it was incredibly challenging when I was doing it but in retrospect, very rewarding as well.