Home » Tag Archives: Big Data (page 3)

Tag Archives: Big Data

Why Data Strategy Matters

software-development-2-logo

Big Data has an alluring promise: crunch all of your datas and find out all these very important unknown things you didn’t know before. You will find out all sorts of important things about your customers. You’ll discover what they’re buying, what they’re not buying, what they like, what they hate. All sorts things that sound very strategic and important. ...

Read More »

The future of Big Data is linked to Cloud

software-development-2-logo

Data volumes are growing exponentially. Unstructured data from Twitter, LinkedIn, Mailling Lists, etc. has the potential to transform many industries if it could be combined with structured data. Machine learning, natural language processing, sentiment analysis, etc. everybody talks about them, hardly anybody is really using them at scale. Too many people when they talk about Big Data unfortunately start with ...

Read More »

Can MapReduce solve planning problems?

software-development-2-logo

To solve a planning or optimization problem, some solvers tend to scale out poorly: As the problem has more variables and more constraints, they use a lot more RAM memory and CPU power. They can hit hardware memory limits at a few thousand variables and few million constraint matches. One way their users typically work around such hardware limits, is ...

Read More »

Big data: when single node is better than clustered

software-development-2-logo

There’s a lot of hype about “big data” and a general trend to try to apply Hadoop to almost every problem. However, sometimes it turns out that you can get much better results by writing an old-fashioned, but optimised, single-node version of your algorithm. The specific case I’m writing about is generating recommendations (what items user may like) basing on ...

Read More »

Big Data: What about Security?

apache-hadoop-logo

From the first time Hadoop appeared it had a security problem. Apache Knox and Cloudera Manager have been solutions for providing authentication and authorization for basic database management functions. Also, the underlying Hadoop Filesystem now incorporates Unix-like permissions. But the issue has not been solved, so usually the pattern followed is to “plunk the S-word after the name of a ...

Read More »

NoSQL is not just about BigData

nosqlunit-logo

There is so much debate on the SQL vs NoSQL subject, and probably this is our natural way of understanding and learning what’s the best way of storing data. After publishing the small experiment on MongoDB aggregating framework, I was challenged by the JOOQ team to match my results against Oracle. Matching MongoDB and Oracle is simply honoring Mongo, as ...

Read More »

Big Data the ‘reactive’ way

software-development-2-logo

A metatrend going on in the IT industry is a shift from query-based, batch oriented systems to (soft) realtime updated systems. While this is associated with financial trading only, there are many other examples such as “Just-In-Time”-logistic systems, flight companies doing realtime pricing of passenger seats based on demand and load, C2C auction system like EBay, real time traffic control ...

Read More »

Drones and Big Data

software-development-logo

Two weeks ago, I had a conversation with some colleagues where I was postulating a future bull market for drones, as I envisioned a number of commercial applications (food service, surveillance, etc). Coincidentally, this topic has gained major momentum since Amazon’s disclosure of a drone R&D project for goods delivery on 60 Minutes this week. Suddenly, everyone has a drone ...

Read More »
Do you want to know how to develop your skillset and become a ...

Subscribe to our newsletter to start Rocking right now!

To get you started we give you our best selling eBooks for FREE!
Get ready to Rock!
To download the books, please verify your email address by following the instructions found on the email we just sent you.

THANK YOU!

Close