Skip to content

Commit

Permalink
Refine AutoML section in README; update dtype format and improve WIP …
Browse files Browse the repository at this point in the history
…notation
  • Loading branch information
mkurman committed Nov 14, 2024
1 parent 5006781 commit 08692ac
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -84,15 +84,17 @@ It is recommended to store your configuration files in the `configs` directory f
- `--eval_dataset`: Hugging Face dataset to evaluate the model. *WIP*
- `--eval_dataset_size`: Size of the evaluation dataset. (default: 20) *WIP*

## AutoML *WIP*
## AutoML
*WIP*

The AutoML feature in this project allows for automated grid search over multiple pruning parameters to find the best configuration for pruning the model. The parameters for the grid search can be specified in a YAML configuration file.

The AutoML feature is currently under development and will be available in version **1.1.0**.

### Example YAML Configuration
```yaml
model_name: "meditsolutions/Llama-3.2-SUN-2.5B-chat"
dtype: "torch.float32"
dtype: "float32"
device: "cuda"
output_dir: "pruned_model"
prune_grid:
Expand Down

0 comments on commit 08692ac

Please sign in to comment.