Harvesting Twitter Data with twarc

UC Santa Barbara, Library

May 26 & 27, 2022

4:00 pm - 6:30 pm PST

Instructors: Jon Jablonski, Kristi Liu, Amanda Ho

Helpers: Grace Nunnelley, Thao Phan, Amelia Meyer, Jingwei Wang

Some adblockers block the registration window. If you do not see the registration box below, please check your adblocker settings.

General Information

Data Carpentry develops and teaches workshops on the fundamental data skills needed to conduct research. Its target audience is researchers who have little to no prior computational experience, and its lessons are domain specific, building on learners' existing knowledge to enable them to quickly apply skills learned to their own research. Participants will be encouraged to help one another and to apply what they have learned to their own research problems.

For more information on what we teach and why, please see our paper "Good Enough Practices for Scientific Computing".

This is a pilot workshop, testing out a lesson that is still under development. The lesson authors would appreciate any feedback you can give them about the lesson content and suggestions for how it could be further improved.

Who: The course is aimed at UCSB researchers who are interested in using Twitter as a datasource in their work. You don't need to have any previous knowledge of the tools that will be presented at the workshop. Learners should come with a basic understanding of computing concepts.

Where: This workshop will support in-person and remote, online attendace. If you register as an in-person attendeee, the workshop will take place at Davidson Library, UCEN Rd, Santa Barbara, CA. If you register as a remote attendeee, the instructors will provide you with the information you will need to connect to this meeting.

When: May 26 & 27, 2022. Add to your Google Calendar.

Requirements: Participants must bring a laptop with a Mac, Linux, or Windows operating system (not a tablet, Chromebook, etc.) that they have administrative privileges on. They should have a few specific software packages installed (listed below).

Accessibility: We are committed to making this workshop accessible to everybody. For workshops at a physical location, the workshop organizers have checked that:

Materials will be provided in advance of the workshop and large-print handouts are available if needed by notifying the organizers in advance. If we can help making learning easier for you (e.g. sign-language interpreters, lactation facilities) please get in touch (using contact details below) and we will attempt to provide them.

Contact: Please email library-collaboratory@ucsb.edu for more information.

Roles: To learn more about the roles at the workshop (who will be doing what), refer to our Workshop FAQ.

Code of Conduct

Everyone who participates in Carpentries activities is required to conform to the Code of Conduct. This document also outlines how to report an incident if needed.

Collaborative Notes

We will use this collaborative document for chatting, taking notes, and sharing URLs and bits of code.


Please be sure to complete these surveys before and after the workshop.

Pre-workshop Survey

Post-workshop Survey


Day 1

Before starting Pre-workshop survey
4:00 pm Workshop Welcome
4:10 pm Introduction
4:30 pm Getting Familiar with JupyterLab
5:10 pmBreak
5:25 pmAnatomy of a Tweet
5:55 pmThe Twitter Public API
6:30 pm End of Day 1

Day 2

4:00 pm Review of Day 1
4:10 pm Ethics and Twitter
4:30 pm Search and Stream
4:55 pm Twarc Plugins
5:10 pmBreak
5:35 pm TextBlob Sentiment Analysis
5:55 pm Data Managment
6:00 pmAnaconda and twarc installation
6:30 pm End Workshop
After Post-workshop survey

The lesson taught in this workshop is being piloted and a precise schedule is yet to be established. The workshop will include regular breaks. Please contact the workshop organisers if you would like more information about the planned schedule.


Make sure to follow all of the Twitter-related instructions on the Lesson Setup Page. You will also need an up-to-date web browser. If you are participating remotely, please also have Zoom installed or updated.

We maintain a list of common issues that occur during installation as a reference for instructors that may be useful on the Configuration Problems and Solutions wiki page.

Install the videoconferencing client

If you haven't used Zoom before, go to the official website to download and install the Zoom client for your computer.

Set up your workspace

Like other Carpentries workshops, you will be learning by "coding along" with the Instructors. To do this, you will need to have both the window for the tool you will be learning about (a terminal, RStudio, your web browser, etc..) and the window for the Zoom video conference client open. In order to see both at once, we recommend using one of the following set up options:

This blog post includes detailed information on how to set up your screen to follow along during the workshop.

We maintain a list of common issues that occur during installation as a reference for instructors that may be useful on the Configuration Problems and Solutions wiki page.