Analytics - Challenges

Challenges

In the industry of commercial analytics software, an emphasis has emerged on solving the challenges of analyzing massive, complex data sets, often when such data is in a constant state of change. Such data sets are commonly referred to as big data. Whereas once the problems posed by big data were only found in the scientific community, today big data is a problem for many businesses that operate transactional systems online and, as a result, amass large volumes of data quickly.

The analysis of unstructured data types is another challenge getting attention in the industry. Unstructured data differs from structured data in that its format varies widely and cannot be stored in traditional relational databases without significant effort at data transformation. Sources of unstructured data, such as email, the contents of word processor documents, PDFs, geospatial data, etc., are rapidly becoming a relevant source of business intelligence for businesses, governments and universities. For example, in Britain the discovery that one company was illegally selling fraudulent doctor's notes in order to assist people in defrauding employers and insurance companies, is an opportunity for insurance firms to increase the vigilance of their unstructured data analysis. The McKinsey Global Institute estimates that big data analysis could save the American health care system $300 billion per year and the European public sector €250 billion.

These challenges are the current inspiration for much of the innovation in modern analytics information systems, giving birth to relatively new machine analysis concepts such as complex event processing, full text search and analysis, and even new ideas in presentation. One such innovation is the introduction of grid-like architecture in machine analysis, allowing increases in the speed of massively parallel processing by distributing the workload to many computers all with equal access to the complete data set.

One more emerging challenge is dynamic regulatory needs. For example, in the banking industry, Basel III and future capital adequacy needs are likely to make even smaller banks adopt internal risk models. In such incidents, cloud computing and open source R can help smaller banks to adopt risk analytics and support branch level monitoring by applying predictive analytics.

Read more about this topic:  Analytics

Other articles related to "challenges, challenge":

Peter The Rock - Catholic View - Challenges - Schism
... The papacy's most widely-known crisis, as well as its largest challenge to authority, came with the "Great Western Schism" (also known as the "Papal Schism") in the late Middle Ages ...
Collaborative Problem Solving
... to understanding and helping children with behavioral challenges that was first articulated by Dr ... The CPS model views behavioral challenges as a form of learning disability or developmental delay -- in other words, behaviorally challenging kids are lacking crucial cognitive skills ... been suggested for behavior management in youth with a variety of behavioral challenges, including youth with bipolar disorder, attention deficit hyperactivity disorder (ADHD), Asperger's disorder, and conduct disorder ...
Project Runway Canada (season 2) - Challenges - Episode 11: The Final Three
... The final three designers - Sunny, Jessica and Jason - are given six months to construct a 12-piece collection for a runway show at Toronto's Fashion Week ... With eight weeks until the show, the designers are discouraged when mentor Brian criticizes their garments ...
Challenges - Other Uses
... Challenge (gasoline), a New Zealand gasoline brand Challenge (literature), an attempt to remove or restrict access to literary materials Challenge (NFL), when a head coach requests the referees review a play ...

Famous quotes containing the word challenges:

    A powerful idea communicates some of its strength to him who challenges it.
    Marcel Proust (1871–1922)

    The approval of the public is to be avoided like the plague. It is absolutely essential to keep the public from entering if one wishes to avoid confusion. I must add that the public must be kept panting in expectation at the gate by a system of challenges and provocations.
    André Breton (1896–1966)