System Context — OCW Studio
Generated 2026-06-24 15:49 UTC · c4gen dev
The widest view: OCW Studio and every external actor and system it exchanges data with. Edges shown are curated and code-verified; raw graph-derived candidates are listed under Dependencies & Cycles.
Interactive
Drag to pan, scroll to zoom. Click the OCW Studio box to drill into its container view.
External systems & peers
| System | Role |
|---|---|
| Concourse CI | CI server (team "ocw") running per-site, theme-assets, mass-build, unpublish, and S3-sync pipelines. Upserted and triggered by Django via the Concourse REST API; pipeline build IDs are stored back on the Website. |
| Hugo Build (ocw-course-publisher) | The ocw-course-publisher container task inside Concourse: runs Hugo over the site content + ocw-hugo-themes/ocw-hugo-projects to produce online and offline (zipped) static sites. |
| S3 Web Buckets (preview / publish / offline) | Destination buckets for built sites: AWS_PREVIEW/PUBLISH_BUCKET_NAME (online draft/live) and AWS_OFFLINE_PREVIEW/PUBLISH_BUCKET_NAME (downloadable zips). Served to learners behind the CDN. |
| S3 Artifacts Bucket | Versioned bucket holding the ocw-hugo-themes webpack manifest (webpack.json) read by every site build. |
| S3 Import Bucket | AWS_IMPORT_STORAGE_BUCKET_NAME — source synced into the storage bucket by the periodic s3-bucket-sync pipeline. |
| Fastly CDN | CDN in front of the published OCW sites; pipelines purge draft/live caches after each build. |
| GitHub (content + theme repos) | Per-site content repos (one per Website, with main/preview/release branches) under GIT_ORGANIZATION, plus mitodl/ocw-hugo-themes and ocw-hugo-projects. Pushes GitHub webhooks to re-sync starter configs. |
| Google Drive | Shared Drive (per-site folders files_final/videos_final) authored by editors; OCW Studio streams files into the S3 storage bucket via a service account. |
| AWS Elemental MediaConvert | Transcodes uploaded videos (via mitol.transcoding); reports completion to OCW Studio by webhook. |
| YouTube Data API | Hosts course videos; OCW Studio streams videos from S3, uploads captions, and polls processing status. |
| 3Play Media | Captioning/transcription vendor; OCW Studio orders transcripts and receives completion callbacks. |
| Touchstone (MIT SAML IdP) | MIT's SAML identity provider (via python-social-auth) authenticating authors and admins. |
| Mailgun | Transactional email (via anymail / mitol.mail) for publish, YouTube upload, and transcript notifications. |
| Internet Archive (Wayback) | Archives valid external-resource URLs and reports save-job status (flagged by ENABLE_WAYBACK_TASKS). |
| Sentry / PostHog | Error monitoring (Sentry) and product analytics (PostHog) telemetry. |
| MIT Learn | Discovery platform / Open Catalog. Receives the OCW publish webhook and its learning_resources ETL ingests OCW site JSON from the published S3 bucket. |