Home
Fundamentals
Research Data Management
FAIR Data Principles
Metadata
Ontologies
Data Sharing
Data Publications
Data Management Plan
Version Control & Git
Public Data Repositories
Persistent Identifiers
Electronic Lab Notebooks (ELN)
DataPLANT Implementations
Annotated Research Context
ARC specification
ARC Commander
Swate
MetadataQuiz
DataHUB
DataPLAN
Ontology Service Landscape
Manuals
ARC Commander
Setup
Git Installation
ARC Commander Installation
Windows
MacOS
Linux
ARC Commander DataHUB Access
Before we start
Central Functions
Initialize
Clone
Connect
Synchronize
Configure
Branch
ISA Metadata Functions
ISA Metadata
Investigation
Study
Assay
Update
Export
ARCitect
Installation - Windows
Installation - macOS
Installation - Linux
QuickStart
QuickStart - Videos
ARCmanager
What is the ARCmanager?
Connect to your DataHUB
View your ARCs
Create new ARCs
Add new studies and assays
Upload files
Add metadata to your ARCs
Swate
QuickStart
QuickStart - Videos
Annotation tables
Building blocks
Building Block Types
Adding a Building Block
Filling cells with ontology terms
Advanced Term Search
File Picker
Templates
Contribute Templates
ISA-JSON
DataHUB
Overview
User Settings
Generate a Personal Access Token (PAT)
Projects Panel
ARC Panel
Forks
Working with files
ARC Settings
ARC Wiki
Groups Panel
Create a new user group
CQC Pipelines & validation
Find and use ARC validation packages
Data publications
Passing Continuous Quality Control
Submitting ARCs with ARChigator
Track publication status
Use your DOIs
Guides
ARC User Journey
Create your ARC
ARCitect QuickStart
ARCitect QuickStart - Videos
ARC Commander QuickStart
ARC Commander QuickStart (Experts)
Annotate Data in your ARC
Annotation Principles
ISA File Types
Best Practices For Data Annotation
Swate QuickStart
Swate QuickStart - Videos
Swate Walk-through
Share your ARC
Register at the DataHUB
DataPLANT account
Invite collaborators to your ARC
Sharing ARCs via the DataHUB
Work with your ARC
Using ARCs with Galaxy
Computational Workflows
CWL Introduction
CWL runner installation
CWL Examples
CWL Metadata
Recommended ARC practices
Syncing recommendation
Keep files from syncing to the DataHUB
Managing ARCs across locations
Working with large data files
Adding external data to the ARC
ARCs in Enabling Platforms
Publication to ARC
Troubleshooting
Git Troubleshooting & Tips
Contribute
Swate Templates
Knowledge Base
Teaching Materials
Events 2023
Nov: CEPLAS PhD Module
Oct: CSCS CEPLAS Start Your ARC
Sept: MibiNet CEPLAS Start Your ARC
July: RPTU Summer School on RDM
July: Data Steward Circle
May: CEPLAS Start Your ARC Series
Start Your ARC Series - Videos
Events 2024
TRR175 Becoming FAIR
CEPLAS ARC Trainings – Spring 2024
MibiNet CEPLAS DataPLANT Tool-Workshops
TRR175 Tutzing Retreat
Frequently Asked Questions
last updated at 2023-06-09
About this guide
In this guide we focus on how to use the ARC Commander to create your ARC and structure, store and share your data.
Before we can start
☑️ Please install ARC Commander
☑️ Find the command line
on your system
:bulb: Consider reading about [ARC](./../implementation/AnnotatedResearchContext.html) and the [ARC Commander](./../implementation/ArcCommander.html)
:bulb: After concluding this quickstart, consider exploring the [ARC Commander manual](./../ArcCommanderManual/index.html) for a more detailed usage instruction.
ARC initialization
- Create and navigate to a local folder, which you want to initialize as an ARC.
mkdir ~/Desktop/QuickStart
cd ~/Desktop/QuickStart
- Initialize your ARC by executing
arc init
- This will create the general ARC folder structure:
Adding metadata
ISA investigation
The ISA investigation (-i
) workbook allows you to record administrative metadata of your project.
The isa.investigation.xlsx workbook including an identifier to your ARC has been added to the project during initialization.
You can update the identifier of your ARC with
arc investigation update -i QuickStartInvestigation
💡 Avoid using spaces in the identifier. Use underscores and capital letters instead.
ISA studies and assays
The ISA study (-s
) and ISA assay (-a
) workbooks allow you to annotate your experimental data.
- Add an isa.study.xlsx workbook including an identifier to your ARC with
arc study add -s QuickStartStudy
- Add an isa.assay.xlsx workbook including an identifier to your ARC with
arc assay add -s QuickStartStudy -a QuickStartAssay
💡 An assay must be linked to a study. If a study does not exist, it will be created automatically in this step.
- The ARC Commander will add a subdirectories to the studies and assays folder. Your ARC should
look similar to this now:
- These steps can be repeated to add as many studies and assays as needed. Accordingly, more subdirectories will be added. Multiple assays can be grouped in a study when the same StudyIdentifier is used.
- Place the data for each assay in the respective dataset folder.
Sharing your ARC
DataPLANT registration and access
In case you are not a member of DataPLANT yet, please visit sign up. Afterwards, you will be granted access to DataPLANT’s DataHUB. The DataHUB allows you to share your ARCs with registered lab or project partners.
After successful registration, setup your machine for smooth ARC synchronization using the ARC Commander
Allow git to store credentials on your machine.
Windows
git config --global credential.helper cache
or
git config --global credential.helper store
MacOS
git config --global credential.helper osxkeychain
Linux
git config --global credential.helper store
Create and set an access token
arc remote accesstoken get -s https://git.nfdi4plants.org
A window within your browser will open, asking for your DataPLANT Log In. In case you are already logged in, the browser will directly display a Success message to you:
ARC synchronization
- Synchronize your ARCs with the DataHUB using the command
arc sync
- If you did not connect your local ARC with a remote one so far, you can specify the remote address with the flag
-r
followed by an URL, e.g.,
arc sync -r https://git.nfdi4plants.org/<YourUserName>/<YourARC>
- In case you want to create a new remote repository at this URL, it needs to be assembled as the following example:
# https://git.nfdi4plants.org/<YourUserName>/<YourARC>
- If no repository exists under the given URL, the ARC Commander will produce an error ensuring that you spelled the URL correctly. To force synchronization, use
arc sync -f
- Check if the upload was successful by visiting your ARC at the respective URL in your browser.
Note: Alternatively, you can first create a new blank repository in the DataHUB by clicking "New project/repository" in the plus drop down menu of the navigation bar on top. Afterwards, you can sync your local ARC to the respective repository by adapting the URL to the newly generated one.
Setting a git user
Some users might want to use different signatures for different repositories, e.g. for developing software on GitHub and working on ARCs on DataPLANT's DataHUB. Besides your global git configuration, you can store the information you want to use for editing ARCs within the ARC Commander config:
arc config set -g -n "general.gitname" -v "Name of choice"
arc config set -g -n "general.gitemail" -v "Email of choice"
To transfer the information from the global ARC Commander config to the local git config of the ARC use
arc config setgituser
Invite collaborators
You can invite lab-colleagues or project partners to join your ARC for collaboration. While inside your ARC on the DataHUB, click on Project information -> Members in the left navigation panel. Search for registered researchers and select a role for each individually. These roles come along with different rights.
Briefly:
- Guests: Have the least rights. They will not be able to see the content of your ARC (only the wiki page).
- Reporters: Have read access to your ARC. This is recommended for people you ask for consultancy.
- Developers: The choice for most people you want to invite to your ARC. Developers have read and write access, but cannot maintain the project on the DataHUB, e.g. inviting others.
- Maintainers: Gives the person the same rights as you have (except of removing you from your own project). This is recommended for inviting PIs or group leaders allowing them to add their group members for data upload or analysis to the project as well.
💡 After concluding this quickstart, you might want to explore the ARC Commander manual for a more detailed usage instruction.
DataPLANT Support
Besides these technical solutions, DataPLANT supports you with community-engaged data stewardship. For further assistance, feel free to reach out via our
helpdesk
or by contacting us
directly
.