Description: 1-The Cranfield collection is a standard IR text collection(included in this directory)., consisting of 1400 documents the aerodynamics field.Write a program that preprocesses the collection.Determine the frequency of occurence for all the words in this collection. Integrate the Porter stemmer and a stopword eliminator into your code.
2- For weighting, use the TF/IDF weighting scheme.For each of the ten queries provided on the class webpage, determine a ranked list of documents, in descending order of their similarity with the query.
3- I will have to implement an efficient and effective spam filter (a text Classifier).
To Search:
File list (Check if you may need any files):
IR project\Assignment1.docx
..........\Assignment2.docx
..........\Assignment3.docx
..........\Project\Assignment3.m
..........\.......\cosine_similarity.m
..........\.......\indexing_Salton.m
..........\.......\indexing_Salton_Q.m
..........\.......\indexing_TFIDF.asv
..........\.......\indexing_TFIDF.m
..........\.......\main.asv
..........\.......\main.m
..........\.......\occurence.m
..........\.......\porterStemmer.m
..........\.......\relevence_judgement.asv
..........\.......\relevence_judgement.m
..........\.......\SGML_eliminate.m
..........\.......\.PAM\Assign3Prj.m
..........\.......\....\cats.txt
..........\.......\....\delims.txt
..........\.......\....\finishLog.m
..........\.......\....\impWords.txt
..........\.......\....\startLog.m
..........\.......\....\test\5-1298msg1.txt
..........\.......\....\....\5-1298msg2.txt
..........\.......\....\....\5-1298msg3.txt
..........\.......\....\....\5-1300msg1.txt
..........\.......\....\....\5-1300msg2.txt
..........\.......\....\....\5-1300msg3.txt
..........\.......\....\....\5-1301msg1.txt
..........\.......\....\....\5-1302msg1.txt
..........\.......\....\....\5-1303msg1.txt
..........\.......\....\....\5-1303msg2.txt
..........\.......\....\....\5-1303msg3.txt
..........\.......\....\....\5-1304msg1.txt
..........\.......\....\....\5-1307msg1.txt
..........\.......\....\....\5-1307msg2.txt
..........\.......\....\....\5-1307msg3.txt
..........\.......\....\....\5-1311msg1.txt
..........\.......\....\....\5-1311msg2.txt
..........\.......\....\....\5-1311msg3.txt
..........\.......\....\....\5-1312msg1.txt
..........\.......\....\....\5-1312msg2.txt
..........\.......\....\....\5-1312msg3.txt
..........\.......\....\....\5-1315msg1.txt
..........\.......\....\....\5-1315msg2.txt
..........\.......\....\....\5-1315msg3.txt
..........\.......\....\....\5-1315msg4.txt
..........\.......\....\....\5-1315msg5.txt
..........\.......\....\....\5-1316msg1.txt
..........\.......\....\....\5-1318msg1.txt
..........\.......\....\....\5-1318msg2.txt
..........\.......\....\....\5-1318msg3.txt
..........\.......\....\....\5-1321msg1.txt
..........\.......\....\....\5-1322msg1.txt
..........\.......\....\....\5-1324msg1.txt
..........\.......\....\....\5-1325msg1.txt
..........\.......\....\....\5-1326msg1.txt
..........\.......\....\....\5-1327msg1.txt
..........\.......\....\....\5-1328msg1.txt
..........\.......\....\....\5-1328msg2.txt
..........\.......\....\....\5-1328msg3.txt
..........\.......\....\....\5-1329msg1.txt
..........\.......\....\....\5-1330msg1.txt
..........\.......\....\....\5-1331msg1.txt
..........\.......\....\....\5-1332msg1.txt
..........\.......\....\....\5-1333msg1.txt
..........\.......\....\....\5-1335msg1.txt
..........\.......\....\....\5-1337msg1.txt
..........\.......\....\....\5-1338msg1.txt
..........\.......\....\....\5-1339msg1.txt
..........\.......\....\....\5-1343msg1.txt
..........\.......\....\....\5-1344msg1.txt
..........\.......\....\....\5-1345msg1.txt
..........\.......\....\....\5-1347msg1.txt
..........\.......\....\....\5-1349msg1.txt
..........\.......\....\....\5-1351msg1.txt
..........\.......\....\....\5-1352msg1.txt
..........\.......\....\....\5-1353msg1.txt
..........\.......\....\....\5-1353msg2.txt
..........\.......\....\....\5-1353msg3.txt
..........\.......\....\....\5-1356msg1.txt
..........\.......\....\....\5-1358msg1.txt
..........\.......\....\....\5-1359msg1.txt
..........\.......\....\....\5-1361msg1.txt
..........\.......\....\....\5-1362msg1.txt
..........\.......\....\....\5-1370msg1.txt
..........\.......\....\....\5-1371msg0.txt
..........\.......\....\....\5-1371msg1.txt
..........\.......\....\....\5-1371msg2.txt
..........\.......\....\....\5-1372msg1.txt
..........\.......\....\....\5-1372msg2.txt
..........\.......\....\....\5-1372msg3.txt
..........\.......\....\....\5-1373msg1.txt
..........\.......\....\....\5-1375msg1.txt
..........\.......\....\....\5-1375msg2.txt
..........\.......\....\....\5-1375msg3.txt
..........\.......\....\....\5-1375msg4.txt
..........\.......\....\....\5-13
Download