{"id":11,"date":"2026-10-28T16:01:17","date_gmt":"2026-10-28T16:01:17","guid":{"rendered":"https:\/\/classprojects.digitalwcu.org\/DESocial\/data\/"},"modified":"2026-11-02T19:11:01","modified_gmt":"2026-11-02T19:11:01","slug":"data","status":"publish","type":"page","link":"https:\/\/classprojects.digitalwcu.org\/DESocial\/data\/","title":{"rendered":"Data"},"content":{"rendered":"<p class=\"dh-eyebrow wp-block-paragraph\">DHM280 \u00b7 Project 2<\/p><p class=\"dh-lead wp-block-paragraph\">The data is public tweets about COVID-19, shared not as the tweets themselves but as tweet IDs: long numbers that each point to one tweet.<\/p><figure class=\"wp-block-image size-full dh-hero dh-shot\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"950\" src=\"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data.jpg\" alt=\"Screenshot of the archive Downloads page listing monthly tweet ID datasets\" class=\"wp-image-53\" srcset=\"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data.jpg 1600w, https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data-300x178.jpg 300w, https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data-1024x608.jpg 1024w, https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data-768x456.jpg 768w, https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-content\/uploads\/2026\/11\/site-data-1536x912.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">The Downloads page: 4.17 billion tweet IDs in monthly datasets. Screenshot, Social Media Lab<\/figcaption><\/figure><div class=\"wp-block-group dh-section is-layout-flow wp-block-group-is-layout-flow\"><h2 class=\"wp-block-heading\">What the data is<\/h2><p class=\"wp-block-paragraph\">Every item in the archive is a public tweet about COVID-19. That ties straight back to the first goal: giving researchers the raw conversation so they can study how information, and misinformation, moved through it.<\/p><\/div><div class=\"wp-block-group dh-section is-layout-flow wp-block-group-is-layout-flow\"><h2 class=\"wp-block-heading\">Why tweet IDs instead of tweets?<\/h2><p class=\"wp-block-paragraph\">Twitter&#8217;s rules didn&#8217;t allow researchers to share full tweets, but they did allow IDs. There is an ethical upside too. If someone deletes a tweet, its ID no longer leads anywhere, so people keep some control over what they posted.<\/p><\/div><div class=\"wp-block-group dh-section is-layout-flow wp-block-group-is-layout-flow\"><h2 class=\"wp-block-heading\">What goes in, what comes out<\/h2><div class=\"wp-block-group dh-grid is-layout-flow wp-block-group-is-layout-flow\"><div class=\"wp-block-group dh-card is-layout-flow wp-block-group-is-layout-flow\"><h3 class=\"wp-block-heading\">Input<\/h3><p class=\"wp-block-paragraph\">A live stream of every public tweet Twitter itself flagged as COVID-related, pulled from Twitter&#8217;s COVID-19 Streaming Endpoint by a custom script the lab wrote. Twitter said the stream had no volume limits.<\/p><\/div><div class=\"wp-block-group dh-card is-layout-flow wp-block-group-is-layout-flow\"><h3 class=\"wp-block-heading\">Output: files<\/h3><p class=\"wp-block-paragraph\">Two files a month: every COVID-19 tweet ID, plus a vaccine-only subset (tweets containing words starting with vaccin*, vacin*, or vax*).<\/p><\/div><div class=\"wp-block-group dh-card is-layout-flow wp-block-group-is-layout-flow\"><h3 class=\"wp-block-heading\">Output: dashboard<\/h3><p class=\"wp-block-paragraph\">Monthly totals; the split between original tweets, retweets, and replies; location and language breakdowns; the most followed and most active accounts; and the most shared links.<\/p><\/div><\/div><\/div><div class=\"wp-block-group dh-section is-layout-flow wp-block-group-is-layout-flow\"><h2 class=\"wp-block-heading\">Is it shared?<\/h2><p class=\"wp-block-paragraph\">Yes, freely, for non-commercial research. Each monthly file has a permanent DOI link through figshare, so citations to the data won&#8217;t break. To get the full tweets back, users &#8220;rehydrate&#8221; the IDs with tools like Hydrator or the Python library Twarc, which is where things get complicated (see <a href=\"\/DESocial\/tools\/\">Tools<\/a>).<\/p><\/div><div class=\"wp-block-group dh-section is-layout-flow wp-block-group-is-layout-flow\"><h2 class=\"wp-block-heading\">Documentation and openness<\/h2><p class=\"wp-block-paragraph\">On openness, the project does very well: free data, a permanent home for it, and a tool to help people use it. Documentation is mostly solid too, apart from the collection gap noted on the <a href=\"\/DESocial\/goals\/\">Goals<\/a> page. The catch is that the openness only goes so far. The IDs are open, but rebuilding the tweets depends on access that Twitter controls.<\/p><\/div><p class=\"dh-pager wp-block-paragraph\"><a href=\"\/DESocial\/goals\/\">\u2190 Goals<\/a><a href=\"\/DESocial\/tools\/\">Tools \u2192<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>DHM280 \u00b7 Project 2 The data is public tweets about COVID-19, shared not as the tweets themselves but as tweet IDs: long numbers that each point to one tweet. What the data is Every item in the archive is a public tweet about COVID-19. That ties straight back to the first goal: giving researchers the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":5,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-11","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/pages\/11","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/comments?post=11"}],"version-history":[{"count":5,"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/pages\/11\/revisions"}],"predecessor-version":[{"id":84,"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/pages\/11\/revisions\/84"}],"wp:attachment":[{"href":"https:\/\/classprojects.digitalwcu.org\/DESocial\/wp-json\/wp\/v2\/media?parent=11"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}