-
Notifications
You must be signed in to change notification settings - Fork 63
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Introduction and Installation instructions docs
- Loading branch information
1 parent
e567071
commit 7d63929
Showing
5 changed files
with
76 additions
and
6 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,37 @@ | ||
# Configuring the CLI. | ||
|
||
## Configure the Host URL | ||
|
||
Before you can start using the EvalAI-CLI to do operations, you have to configure the host URL of the EvalAI instance that you want to connect to. | ||
|
||
In the rest of this docs, we would be using `http://evalapi.cloudcv.org/` URL which is where the backend for the EvalAI server is hosted. | ||
|
||
We need to configure our CLI to work with this backend. | ||
|
||
`evalai configure -sh http://evalapi.cloudcv.org/` | ||
|
||
Now, the CLI is ready to communicate with the backend. If you want to reconfigure the CLI with a different instance of EvalAI, you can use the same command. | ||
|
||
## Token Authentication | ||
|
||
Now, you have to get your own unique token to connect to your own account for performing the different operations. | ||
|
||
Step 1: Go to your account in the EvalAI web app and go to you profile. | ||
|
||
Step 2: Click the `Get Authentication Token` button in your profile. | ||
|
||
Step 3: Click `Download as JSON` to download the token in a file. | ||
|
||
Step 4: In the terminal, go to you home directory. | ||
|
||
`cd ~` | ||
|
||
Step 5: Create a dedicated folder for EvalAI's configurations. | ||
|
||
`mkdir .evalai` | ||
|
||
Step 5: Copy the `token.json` into the newly created `.evalai` folder. | ||
|
||
`mv Downloads/token.json ~/.evalai` | ||
|
||
Now you're all set and ready to go! |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
# Installation | ||
|
||
|
||
## Install Python pip | ||
|
||
Have the latest version of pip and preferably Python-3 installed. | ||
|
||
`sudo apt-get install python-pip` | ||
|
||
|
||
## EvalAI CLI installation | ||
|
||
Install EvalAI CLI from pip. | ||
|
||
`pip install evalai` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
# Welcome | ||
|
||
|
||
## What is [EvalAI](https://github.com/Cloud-CV/EvalAI)? | ||
|
||
EvalAI is an open source web application that helps researchers, students and data-scientists to create, collaborate and participate in various AI challenges organized round the globe. | ||
|
||
In recent years, it has become increasingly difficult to compare an algorithm solving a given task with other existing approaches. These comparisons suffer from minor differences in algorithm implementation, use of non-standard dataset splits and different evaluation metrics. By providing a central leaderboard and submission interface, we make it easier for researchers to reproduce the results mentioned in the paper and perform reliable & accurate quantitative analysis. By providing swift and robust backends based on map-reduce frameworks that speed up evaluation on the fly, EvalAI aims to make it easier for researchers to reproduce results from technical papers and perform reliable and accurate analyses. | ||
|
||
|
||
## What is the [EvalAI-CLI](https://github.com/Cloud-CV/EvalAI-CLI)? | ||
|
||
EvalAI CLI was designed to extend the functionality of the EvalAI web app to the command line. EvalAI CLI offers you most of the core features of the EvalAI web app on your termial, enabling you to keep the efficiency of working on a terminal, from make a submission to viewing the results of a competition without ever leaving the terminal. EvalAI CLI is cross-platform supported and is available of PyPI. |