.. _mooc: ************************************* MOOC - Introduction to Grid Computing ************************************* This page includes the complete course material as presented during the SURFsara MOOC ``Introduction to Grid Computing``: .. contents:: :depth: 2 ===== About ===== As of 18 November 2013, SURFsara offered the Massive Open Online Course (MOOC) ``Introduction to Grid Computing``. The course aimed to help researchers to understand the Grid key concepts and the role of Grid Computing in computationally intensive problems. This included working with portals, workflow management systems and the Grid middleware. The taught material consists of: * a set of **video lectures**. * a set of **quizzes**, **assignments** and **exercises**. * real world examples of **use cases** on Grid. .. note:: The mooc participants were provided with student accounts and a preconfigured Virtual Machine (VM) with all the necessary Grid tools installed. If you want to run the examples presented in the video lectures below you will have to request your personal Grid account, see :ref:`prerequisites`. Please contact helpdesk@surfsara.nl if you need help with this. .. _mooc-lectures: ======== Lectures ======== The entire course video lectures can be found in the `MOOC Video lectures`_. .. _mooc-overview: Course Overview =============== Course Overview slides :download:`pdf ` .. _mooc-distr-computing: Introduction to Parallel and Distributed Computing ================================================== Intro to Parallel and Distributed Computing :download:`pdf ` .. _mooc-cluster-computing: Cluster Computing ================= Cluster Computing :download:`pdf ` .. _mooc-grid-overview: Grid Computing Overview ======================= Grid Computing Overview :download:`pdf ` .. _mooc-glossary: Grid_Glossary ============= Grid Glossary :download:`pdf ` Hands-on set ------------ Exercises Distributed Cluster Grid :download:`pdf ` Quiz Distributed Cluster Grid :download:`pdf ` .. _mooc-grid-prerequisites: Working Environment - Grid prerequisites ========================================= Working Environment_I Grid prerequisites :download:`pdf ` .. _remote-access: Working Environment - Remote access ==================================== Working Environment II Remote access :download:`pdf ` Code gridpi :download:`tar ` .. _mooc-about-certificate: Grid Certificate - Security =========================== Grid Certificate I (security) :download:`pdf ` Grid Certificate I (extras) :download:`pdf ` .. _mooc-get-certificate: Obtain a Grid Certificate ========================== .. sidebar:: Sectigo: new way to request a certificate! .. note:: Sectigo allows you to get your Grid certificate instantly from the GEANT Trusted Certificate Service (instead of Terena portal), by using your institutional login and SURFconext. Read the `User Guide`_ or login directly on the `Sectigo portal`_. Grid Certificate II (Obtaining a certificate) :download:`pdf ` .. _mooc-ui: User Interface machine ====================== User Interface machine :download:`pdf ` .. _mooc-vo: Virtual Organisations ===================== Virtual Organisations :download:`pdf ` Hands-on set ------------ Exercises Install Certificate :download:`pdf ` Quiz_Install Certificate :download:`pdf ` .. _mooc-job-lifecycle: Grid job Lifecycle ================== Grid job Lifecycle :download:`pdf ` .. _mooc-startgridsession: Start a Grid_Session ==================== Start a Grid Session :download:`pdf ` .. _mooc-submit-job: My First Grid job ================= My First Grid job :download:`pdf ` Code MyFirstJob :download:`tar ` .. _mooc-toolkit: Grid Toolkit ============ Grid Toolkit :download:`pdf ` Hands-on set ------------ Quick start guide :download:`pdf ` Exercises First Grid job :download:`pdf ` Quiz_First Grid job :download:`pdf ` .. _mooc-submit-app: Application_submission to Grid I ================================ Application submission to Grid I script :download:`pdf ` Code script :download:`tar ` .. _mooc-bootstrap: Application_submission to Grid II ================================= Application submission to Grid II executable :download:`pdf ` Code compiled :download:`tar ` .. _mooc-parametric: Advanced Grid jobs I ==================== Advanced Grid jobs I Collections & Parametric :download:`pdf ` Code Collections Parametric :download:`tar ` .. _mooc-multicore: Advanced Grid jobs II ===================== Advanced Grid jobs II Multicore :download:`pdf ` Code multicore :download:`tar ` .. _mooc-hadoop: Data parallel processing Hadoop =============================== Data parallel processing Hadoop :download:`pdf ` Hands-on set ------------ Exercises Advanced Jobs :download:`pdf ` Quiz Advanced Jobs :download:`pdf ` .. sidebar:: lcg/lfc/lfn? Only for large files with multiple replicas. The lectures ``Data Management on the Grid [1-3]`` present the lcg/lfc/lfn :ref:`storage-clients`. However, we advise you to better use the :ref:`globus` or :ref:`srm` tools, unless you need to run jobs on multiple sites which require access on the **same** large dataset (or database). In case of doubts, contact us at helpdesk@surfsara.nl. .. _mooc-lcg-lfn1: Data Management on the Grid I ============================= Data Management on the Grid I :download:`pdf ` .. _mooc-lcg-lfn2: Data Management on the Grid II ============================== Data Management on the Grid II :download:`pdf ` .. _mooc-lcg-lfn3: Data Management on the Grid III =============================== Data Management on the Grid III :download:`pdf ` Code DMlargefiles :download:`tar ` .. _mooc-srm: Storage Resource Manager ======================== Storage Resource manager :download:`pdf ` Code DMsrm :download:`tar ` Hands-on set ------------ Exercises_Data Management :download:`pdf ` Quiz_Data Management :download:`pdf ` .. _mooc-workflows1: Introduction to Workflows I =========================== Introduction to Workflows I :download:`pdf ` .. _mooc-workflows2: Introduction to Workflows II ============================ Introduction to Workflows II :download:`pdf ` .. _mooc-wspgrade1: WS-Pgrade I =========== WSpgrade I :download:`pdf ` .. _mooc-wspgrade2: WS-Pgrade II ============ WSpgrade II :download:`pdf ` .. _mooc-gateways: Science Gateways ================ Science Gateways :download:`pdf ` Hands-on set ------------ Exercises Workflows :download:`pdf ` Code Exercises Workflows :download:`tar ` Code Solutions Workflows :download:`tar ` Quiz Workflows :download:`pdf ` .. _mooc-pilot-jobs: Pilot Job Frameworks ==================== Pilot job frameworks :download:`pdf ` .. _mooc-picas-server1: Picas Server side I =================== Picas server side I :download:`pdf ` .. _mooc-picas-server2: Picas Server side II ==================== Picas server side II :download:`pdf ` .. _mooc-picas-client: Picas client side ================= Picas client side :download:`pdf ` .. _mooc-picas-example1: Picas practise I ================ Code Picas :download:`tar ` .. _mooc-picas-example2: Picas practise II ================= Code Picas :download:`tar ` Course Summary ============== Course summary :download:`pdf ` ========= Use cases ========= Use case: EGI overview ====================== EGI overview :download:`pdf ` Use case: LOFAR =============== Extreme physics in space :download:`pdf ` Use case: Climate change over Europe ==================================== Climate change :download:`pdf ` Use case: VisIVO Science Gateway ================================ VisIVO Science Gateway :download:`pdf ` Use case: Picas =============== Picas :download:`pdf ` Use case: Molecular Biology =========================== Molecular Biology :download:`pdf ` .. _mooc-animations: ========== Animations ========== We have prepared a set of animations to display the basic usage of Grid Infrastructure. The animations were presented during the lectures. =========== EGI-InSPIRE =========== *The work is supported by the EGI-InSPIRE project (Integrated Sustainable Pan-European Infrastructure for Researchers in Europe), co-funded by the European Commission (contract number: RI-261323) for four years from the 1st of May 2010. EGI-InSPIRE is a collaborative effort involving more than 50 institutions in over 40 countries. Its mission is to establish a sustainable European Grid Infrastructure (EGI).* .. Links: .. _`Mooc Animations`: http://web.grid.sara.nl/mooc/animations/ .. _`User Guide`: https://ca.dutchgrid.nl/tcs/TCS-enduser-request-guide-NL-2020-04.pdf .. _`DigiCert portal`: https://digicert.com/sso .. _`Sectigo portal`: https://cert-manager.com/customer/surfnet/idp/clientgeant .. _`MOOC Video lectures`: https://www.youtube.com/playlist?list=PLxLmEiwjudnxsettwXEj8SeU--sTsoqvz