Text Mining

Text mining, sometimes alternately referred to as text data mining, roughly equivalent to text analytics, refers to the process of deriving high-quality information from text. High-quality information is typically derived through the devising of patterns and trends through means such as statistical pattern learning. Text mining usually involves the process of structuring the input text (usually parsing, along with the addition of some derived linguistic features and the removal of others, and subsequent insertion into a database), deriving patterns within the structured data, and finally evaluation and interpretation of the output. 'High quality' in text mining usually refers to some combination of relevance, novelty, and interestingness. Typical text mining tasks include text categorization, text clustering, concept/entity extraction, production of granular taxonomies, sentiment analysis, document summarization, and entity relation modeling (i.e., learning relations between named entities).

Text analysis involves information retrieval, lexical analysis to study word frequency distributions, pattern recognition, tagging/annotation, information extraction, data mining techniques including link and association analysis, visualization, and predictive analytics. The overarching goal is, essentially, to turn text into data for analysis, via application of natural language processing (NLP) and analytical methods.

A typical application is to scan a set of documents written in a natural language and either model the document set for predictive classification purposes or populate a database or search index with the information extracted.

Read more about Text MiningText Mining and Text Analytics, History, Text Analysis Processes, Applications, Software and Applications, Implications

Other articles related to "text mining, text, mining":

Text Mining - Implications
... Until recently, websites most often used text-based searches, which only found documents containing specific user-defined words or phrases ... Now, through use of a semantic web, text mining can find content based on meaning and context (rather than just by a specific word) ... Additionally, text mining software can be used to build large dossiers of information about specific people and events ...
Text Analytics
... Text mining, also referred to as text data mining, roughly equivalent to text analytics, refers to the process of deriving high-quality information from text ... Text mining usually involves the process of structuring the input text (usually parsing, along with the addition of some derived linguistic features and the removal of others, and subsequent insertion ... 'High quality' in text mining usually refers to some combination of relevance, novelty, and interestingness ...
List Of Chatterbots - Processes of NLP - Component Processes
... Automatic document classification (text categorization) – Automatic language identification – Discourse analysis – includes a number of related ... One task is identifying the discourse structure of connected text, i.e ... and classifying the speech acts in a chunk of text (e.g ...
Text Analytics - See Also
... Web mining, a task that may involve text mining (e.g ... web pages, then extract the desired information from the text content of these pages considered relevant) ... w-shingling Sequence mining String and Sequence Mining Noisy text analytics Named entity recognition Identity resolution News analytics ...
List Of Natural Language Processing Toolkits - Processes of NLP - Component Processes - Component Processes of Natural Language Understanding
... Automatic document classification (text categorization) – Automatic language identification – Compound term processing – category of techniques that identify compound terms and match them to their definitions ... Corpus processing – Automatic acquisition of lexicon – Text normalization – Text simplification – Deep linguistic processing – Discourse analysis – includes a number of ... the discourse structure of connected text, i.e ...

Famous quotes containing the words mining and/or text:

    In strict science, all persons underlie the same condition of an infinite remoteness. Shall we fear to cool our love by mining for the metaphysical foundation of this elysian temple? Shall I not be as real as the things I see? If I am, I shall not fear to know them for what they are.
    Ralph Waldo Emerson (1803–1882)

    I am so glad you have been able to preserve the text in all of its impurity.
    Samuel Beckett (1906–1989)