From Free Software Directory
|
|
Line 1: |
Line 1: |
− | {{Entry
| + | #REDIRECT [[mc 2]] |
− | |Name=MC
| |
− | |Short description=Converts text documents into a vector space model
| |
− | |Full description=MC is a C++ program that creates vector-space models from text documents that can be used for text mining applications. MC provides an efficient multi-threaded implementation that can process very large document collections. The MC program: 1. Recursively descends directories, finding text files 2. Processes files selectively through full regular expression matching of file names. 3. Builds a sparse matrix of word/token counts. The particular sprse marix format used is given here. 4. Processes any user specified text formats(email address or URLs) as a whole token through regular expression matching or FLEX definition. 5. Prunes vocabulary by word length and frequency 6. Excludes user specified stop words 7. Sets word vector weights according any of the txx, txn, tfn, tfx, lxx, lxn, lfn, lfx scaling schemes. 8. Writes all data structures to disk in the Compressed Column Storage format. The application does not have English parsing or part-of-speech tagging facilities or complete documentation
| |
− | |User level=intermediate
| |
− | |Status=Live
| |
− | |Component programs=
| |
− | |Homepage URL=http://www.cs.utexas.edu/users/jfan/dm/
| |
− | |VCS checkout command=
| |
− | |Computer languages=C++
| |
− | |Documentation note=User READEM available in HTML format from http://www.cs.utexas.edu/users/jfan/dm/README.html
| |
− | |Paid support=
| |
− | |IRC help=
| |
− | |IRC general=
| |
− | |IRC development=
| |
− | |Related projects=
| |
− | |Keywords=data mining,text mining,vector space model,bag of words,MC
| |
− | |Is GNU=n
| |
− | |Last review by=James Fan
| |
− | |Last review date=2007-11-29
| |
− | |Submitted by=Database conversion
| |
− | |Submitted date=2011-04-01
| |
− | |Version identifier=2.19
| |
− | |Version date=2001-06-26
| |
− | |Version status=stable
| |
− | |Version download=http://www.cs.utexas.edu/users/jfan/dm/src/
| |
− | |License verified date=2001-07-02
| |
− | |Version comment=2.19 stable released 2001-06-26
| |
− | }}
| |
− | {{Person
| |
− | |Role=Maintainer
| |
− | |Real name=James Fan
| |
− | |Email=jfan@cs.utexas.edu
| |
− | |Resource URL=
| |
− | }}
| |
− | {{Resource
| |
− | |Resource audience=Bug Tracking,Developer,Support
| |
− | |Resource kind=E-mail
| |
− | |Resource URL=mailto:jfan@cs.utexas.edu
| |
− | }}
| |
− | {{Software category
| |
− | |Database=administration
| |
− | |Interface=command-line
| |
− | |Works-with=database
| |
− | }}
| |
− | {{Project license
| |
− | |License=GPLv2
| |
− | |License verified by=Janet Casey
| |
− | |License verified date=2001-07-02
| |
− | }}
| |
− | {{Software prerequisite
| |
− | |Prerequisite kind=Required to build
| |
− | |Prerequisite description=pthread library
| |
− | }}
| |
− | {{Software prerequisite
| |
− | |Prerequisite kind=Required to build
| |
− | |Prerequisite description=STL
| |
− | }}
| |
− | {{Software prerequisite
| |
− | |Prerequisite kind=Required to build
| |
− | |Prerequisite description=FLEX
| |
− | }}
| |
Revision as of 14:59, 16 December 2011
Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License, Version 1.3 or
any later version published by the Free Software Foundation; with no
Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A
copy of the license is included in the page “GNU Free
Documentation License”.
The copyright and license notices on this page only apply to the
text on this page. Any software or copyright-licenses or other
similar notices described in this text has its own copyright notice
and license, which can usually be found in the distribution or license
text itself.