{"id":47,"date":"2025-04-01T16:59:28","date_gmt":"2025-04-01T16:59:28","guid":{"rendered":"https:\/\/classprojects.digitalwcu.org\/ENAA\/?page_id=47"},"modified":"2025-04-29T15:09:41","modified_gmt":"2025-04-29T15:09:41","slug":"methods","status":"publish","type":"page","link":"https:\/\/classprojects.digitalwcu.org\/ENAA\/methods\/","title":{"rendered":"Methods"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" src=\"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-content\/uploads\/2025\/04\/Screenshot-2025-04-29-at-10.57.56\u202fAM-2.heic\" alt=\"\" class=\"wp-image-162\"\/><\/figure>\n<\/div>\n\n\n<div class=\"wp-block-group is-nowrap is-layout-flex wp-container-core-group-is-layout-8f761849 wp-block-group-is-layout-flex\">\n<ol class=\"wp-block-list\">\n<li>The Viral Texts Project\u2019s reliance on pre-Civil War newspapers from Chronicling America&nbsp;highlights both the opportunity and the challenge of using large-scale, openly available historical data, this  offers extensive content but suffers from OCR errors and significant geographic gaps particularly the absence of newspapers from Massachusetts for understanding the diffusion of ideas.<\/li>\n<\/ol>\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">2. The use of 5-gram matching and shingling in detecting reprinted texts&nbsp;reflects the project&#8217;s pragmatic balance between precision and computational feasibility, allowing researchers to identify reused content across thousands of newspapers while managing OCR-induced noise and the lack of article-level boundaries.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3. The Location-Based Two-Pass algorithm for efficient n-gram indexing&nbsp;is a crucial computational strategy that reduces storage needs while preserving accuracy, enabling scalable detection of repeated textual patterns even within massive, noisy corpora.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Best Practices: Does It Meet Them? \u2705<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Yes, mostly<\/strong>:\n<ul class=\"wp-block-list\">\n<li>\u2714\ufe0f&nbsp;<strong>Open access data<\/strong>&nbsp;and transparent methods.<\/li>\n\n\n\n<li>\u2714\ufe0f&nbsp;<strong>Interdisciplinary tools<\/strong>&nbsp;combining computational and historical methods.<\/li>\n\n\n\n<li>\u2714\ufe0f&nbsp;<strong>Attention to social impact<\/strong>, especially marginalized voices.<\/li>\n\n\n\n<li>\u26a0\ufe0f&nbsp;<strong>Challenges with data completeness and OCR quality<\/strong>&nbsp;limit full inclusivity.<\/li>\n\n\n\n<li>\u2714\ufe0f&nbsp;<strong>Ethical awareness<\/strong>&nbsp;of historical context and implications of text reuse.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>2. The use of 5-gram matching and shingling in detecting reprinted texts&nbsp;reflects the project&#8217;s pragmatic balance between precision and computational feasibility, allowing researchers to identify reused content across thousands of newspapers while managing OCR-induced noise and the lack of article-level boundaries. 3. The Location-Based Two-Pass algorithm for efficient n-gram indexing&nbsp;is a crucial computational strategy that [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":7,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-47","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/pages\/47","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/comments?post=47"}],"version-history":[{"count":7,"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/pages\/47\/revisions"}],"predecessor-version":[{"id":163,"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/pages\/47\/revisions\/163"}],"wp:attachment":[{"href":"https:\/\/classprojects.digitalwcu.org\/ENAA\/wp-json\/wp\/v2\/media?parent=47"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}