Free Software Foundation!

Join now

Browse wiki

Jump to: navigation,
Mc 2
Database administration  +
Full description MC is a C++ program that creates vector-spMC is a C++ program that creates vector-space models from text documents that can be used for text mining applications. MC provides an efficient multi-threaded implementation that can process very large document collections. The MC program: 1. Recursively descends directories, finding text files 2. Processes files selectively through full regular expression matching of file names. 3. Builds a sparse matrix of word/token counts. The particular sprse marix format used is given here. 4. Processes any user specified text formats(email address or URLs) as a whole token through regular expression matching or FLEX definition. 5. Prunes vocabulary by word length and frequency 6. Excludes user specified stop words 7. Sets word vector weights according any of the txx, txn, tfn, tfx, lxx, lxn, lfn, lfx scaling schemes. 8. Writes all data structures to disk in the Compressed Column Storage format. The application does not have English parsing or part-of-speech tagging facilities or complete documentationgging facilities or complete documentation
Homepage URL http://web.archive.org/web/20090921192233/http://www.cs.utexas.edu/users/jfan/dm/  +
Interface command-line  +
Is GNU false  +
Keywords data-mining  + , text-mining  + , vector-space-model  + , bag-of-words  +
Last review by BABA200 +
Last review date 20 February 2017  +
License GPLv2 +
License verified by Janet Casey  +
License verified date 2 July 2001  +
Name mc  +
Prerequisite description STL  + , pthread library  + , FLEX  +
Prerequisite kind Required to build  +
Programming-language C++  +
Real name James Fan  +
Revisionid 43,794  +
Revisiontimestamp 20 February 2017 15:14:54  +
Revisionuser User:BABA200 +
Role Maintainer  +
Runs-on GNU/Linux  +
Short description Converts text documents into a vector space model  +
Submitted by Database conversion +
Submitted date 1 April 2011  +
User level none  +
Version date 9 November 2004  +
Version identifier 2.29  +
Version status stable  +
Works-with database  +
Has queryThis property is a special property in this wiki. Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 +
Has improper value forThis property is a special property in this wiki. Version download  +
Categories Entry  +
Modification dateThis property is a special property in this wiki. 20 February 2017 19:14:54  +
Page has default formThis property is a special property in this wiki. Entry  +
Has subobjectThis property is a special property in this wiki. Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 + , Mc 2 +
EmailThis property is a special property in this wiki. jfan@cs.utexas.edu  +
show properties that link here 

 

Enter the name of the page to start browsing from.



Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the page “GNU Free Documentation License”.

The copyright and license notices on this page only apply to the text on this page. Any software or copyright-licenses or other similar notices described in this text has its own copyright notice and license, which can usually be found in the distribution or license text itself.


Personal tools
Namespaces

Variants
Views
Actions
Interaction
Navigation
Tools
Print