Programming with Python and Intro to Webscraping

University of California, Santa Barbara

Online

January 4th, 7th 2022

Tuesday, 1 pm - 5 pm; Friday 9 am - 1 pm PST

Instructors: Greg Janée, Amanda Ho

Helpers: Sam Csik, Kat Le, Kristi Liu, Jamie Montgomery

This workshop will take place between the main UCSB Campus and the NCEAS downtown location

This workshop will now be online due to temporary remote instruction. Please keep an eye on your email for more information.

Some adblockers block the registration window. If you do not see the registration box below, please check your adblocker settings.

General Information

Data Carpentry develops and teaches workshops on the fundamental data skills needed to conduct research. Its target audience is researchers who have little to no prior computational experience, and its lessons are domain specific, building on learners' existing knowledge to enable them to quickly apply skills learned to their own research. Participants will be encouraged to help one another and to apply what they have learned to their own research problems.

For more information on what we teach and why, please see our paper "Good Enough Practices for Scientific Computing".

Who: The course is aimed at graduate students and other researchers. You don't need to have any previous knowledge of the tools that will be presented at the workshop.

Where: This training will take place online. The instructors will provide you with the information you will need to connect to this meeting.

This workshop's location will be split between the main UCSB Campus and NCEAS Downtown.
Jan 4th will be at the UCSB Library Jan 7th will be at NCEAS Downtown

When: January 4th, 7th 2022. Add to your Google Calendar.

Requirements: Participants must have access to a computer with a Mac, Linux, or Windows operating system (not a tablet, Chromebook, etc.) that they have administrative privileges on. They should have a few specific software packages installed (listed below).

Accessibility: We are dedicated to providing a positive and accessible learning environment for all. Please notify the instructors in advance of the workshop if you require any accommodations or if there is anything we can do to make this workshop more accessible to you.

Contact: Please email library-collaboratory@ucsb.edu for more information.

Roles: To learn more about the roles at the workshop (who will be doing what), refer to our Workshop FAQ.


Code of Conduct

Everyone who participates in Carpentries activities is required to conform to the Code of Conduct. This document also outlines how to report an incident if needed.


Collaborative Notes

We will use this collaborative document for chatting, taking notes, and sharing URLs and bits of code.


Surveys

Please be sure to complete these surveys before and after the workshop.

Pre-workshop Survey

Post-workshop Survey


Schedule

Day 2

09:00 am Review
09:10 am Loops and Fuctions
09:50 am Making Plots With plotnine
10:15 am Break
10:05 am What is web scraping and it's proper practices?
10:20 am Webscraping in Pandas
11:15 am Break
11:25 am Webscraping in Pandas
12:15 pm Review
12:30 pm END
After Post-workshop Survey

Setup

To participate in a Data Carpentry workshop, you will need access to software as described below. In addition, you will need an up-to-date web browser.

We maintain a list of common issues that occur during installation as a reference for instructors that may be useful on the Configuration Problems and Solutions wiki page.

Data

Data for this lesson is from the Portal Project Teaching Database. Specifically, we use the following eight data files:

Please download them (by clicking on the corresponding links) and move them to the same directory, or download all the files as a zip which will give you everything in a single compressed file. You'll need to unzip this file after downloading it.

Install the videoconferencing client

If you haven't used Zoom before, go to the official website to download and install the Zoom client for your computer.

Set up your workspace

Like other Carpentries workshops, you will be learning by "coding along" with the Instructors. To do this, you will need to have both the window for the tool you will be learning about (a terminal, RStudio, your web browser, etc..) and the window for the Zoom video conference client open. In order to see both at once, we recommend using one of the following set up options:

This blog post includes detailed information on how to set up your screen to follow along during the workshop.

The setup instructions for the Data Carpentry Ecology workshops (with Python) can be found at the workshop overview site.