What is the ThinkChicago Workbench?
The ThinkChicago Workbench is a cloud-based service with a set of general-purpose development and data analysis environments to help you to explore your ideas with the ThinkChicago data. All applications run as Docker containers on a system hosted by the National Center for Supercomputing Applications (NCSA) at the University of Illinois at Urbana-Champaign.
What data is available?
The ThinkChicago workbench provides access to the following datasets. Many of these datasets are also available via the City of Chicago Data Portal REST API.
Dataset | Description | API | Size (CSV) |
---|---|---|---|
2FM Tech Challenge | Fleet and Facilities Management (2FM) vehicle and equipment data. | N/A | 534M |
Array of Things Locations | Locations of Array of Things sensor nodes. | REST API | 6.5K CSV; 28K JSON |
Incidents of crime since 2001. | REST API | 1.4G CSV | |
Individual Divvy bike sharing trips, including the origin, destination, and timestamps for each trip | REST API | 2.4G CSV | |
Historical availability of bicycles and docks to return bicycles at the Divvy stations. | REST API | 9.4G CSV | |
Taxi trips reported to the City of Chicago. | REST API | 8.0GB CSV only |
Each of these datasets is available in the /shared directory of any running application in Workbench.
Note that some of these files are large and you will not be able to read the entire file into memory. Please prepare accordingly (and see resource limits below).
What applications are available?
- Cloud9 development environments for popular languages including Python, Java, PHP, and Node.js
- Data analysis environments including Jupyter Notebooks and RStudio
- Database and data management software including MySQL, PostgresSQL, and MongoDB
Resource limits
Each user account is limited to 4 cores, 8GB RAM memory, and 10GB storage. This means that you will not be able to read entire datasets into memory or start many different applications.
Getting getting data on/off Workbench
- Github: We strongly encourage you to use Github (or similar service) to store all of your source code and data.
- File Manager: The Workbench File Manager application can be used to upload/download data.
/home and /shared
Along with the /shared directory described above, your /home directory is available in every running application. Just look under /home/<userid>.
Where can I get help?
- Join the ThinkChicago Slack team https://thinkchicago.slack.com/ and post a message.
- Send an email to ndslabs-support@nationaldataservice.org