Implementasi Algoritma TF-IDF Pada Pengukuran Kesamaan Dokumen
Total View This Week0
Total View This Week0
Institusion
Universitas Katolik Musi Charitas
Author
Ryansyah, Adi
Subject
T Technology (General)
Datestamp
2018-03-26 05:13:12
Abstract :
Documents similarity measure is a time consuming problem. The large amount of documents and the large number of pages per document are causing the similarity measures to become a complicated and hard job to do manually. In this research, a system that can automatically measuring similarity between documents is built by implementing TF-IDF. Measurements are carried by first creating a vector representation of documents being compared. This vector representation containing the weight of each term in the documents. After that, the similarity values are calculated using cosine similarity. This research used waterfall model. System design is done using Unified Modeling Language (UML) and implemented in Java programming language with Netbeans as IDE. The documents used in this research are ten thesis reports from computer science major, eight from information system major, and ten reports from industrial engineering major of Sekolah Tinggi Teknik Musi. The finished system can carry out comparison of documents in pdf or word format. Document comparison can be done using all the chapters in the report, or just a few selected chapters that are considered significant. Based on experiment, it can be concluded that tf-idf needs at least three documents to be available in the document collection being processed. The test of correlation shows that for document in pdf format, there is a significant correlation between the amount of characters in the document with the processing time.
Documents similarity measure is a time consuming problem. The large amount of documents and the large number of pages per document are causing the similarity measures to become a complicated and hard job to do manually. In this research, a system that can automatically measuring similarity between documents is built by implementing TF-IDF. Measurements are carried by first creating a vector representation of documents being compared. This vector representation containing the weight of each term in the documents. After that, the similarity values are calculated using cosine similarity. This research used waterfall model. System design is done using Unified Modeling Language (UML) and implemented in Java programming language with Netbeans as IDE. The documents used in this research are ten thesis reports from computer science major, eight from information system major, and ten reports from industrial engineering major of Sekolah Tinggi Teknik Musi. The finished system can carry out comparison of documents in pdf or word format. Document comparison can be done using all the chapters in the report, or just a few selected chapters that are considered significant. Based on experiment, it can be concluded that tf-idf needs at least three documents to be available in the document collection being processed. The test of correlation shows that for document in pdf format, there is a significant correlation between the amount of characters in the document with the processing time.
File :
IF-2014-310007-cover.pdf
IF-2014-310007-abstract.pdf
IF-2014-310007-complete.pdf
IF-2014-310007-summary_id.pdf
IF-2014-310007-tableofcontent.pdf
IF-2014-310007-chapter1.pdf
IF-2014-310007-chapter2.pdf
IF-2014-310007-chapter3.pdf
IF-2014-310007-chapter4.pdf
IF-2014-310007-conclusion.pdf
IF-2014-310007-reference.pdf
IF-2014-310007-attachment.pdf
Download
book
BibTex
Latex, Jabref
cloud_download
Original Resource
url resource Institution
