Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added timeseries classification example via Fedot.Industrial #6

Open
wants to merge 19 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -194,4 +194,7 @@ chroma/
# AutoMLAgent
exec_out/
_experiments/
results/
results/

# Docker
docker/docker_caches/
9 changes: 9 additions & 0 deletions .pep8speaks.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
scanner:
diff_only: False # The entire file touched by the Pull Request is scanned for errors.
linter: pycodestyle

pycodestyle:
max-line-length: 120 # Default is 79 in PEP 8
ignore: []

no_blank_comment: False # Every PR will have its own PEP 8 stats.
27 changes: 27 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
DC = docker compose
EXEC = docker exec -it
APP_FILE = docker/docker-compose.yml
APP_CONTAINER = fdlm-app
ENV = --env-file .env
SH = /bin/bash

.PHONY: build
build:
${DC} ${ENV} -f ${APP_FILE} up -w --build

.PHONY: up
up:
${DC} ${ENV} -f ${APP_FILE} up -w

.PHONY: down
down:
${DC} -f ${APP_FILE} down

.PHONY: appsh
app-sh:
${EXEC} -it ${APP_CONTAINER} ${SH}
app-py:
${EXEC} -it ${APP_CONTAINER} poetry shell

streamlit-st:
python -m streamlit run libs/fedotllm/streamlit-app.py --server.port=8080 --server.address=0.0.0.0
16 changes: 15 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,10 @@
<img src="/docs/fedot-llm.png" width="600" title="Fedot.LLM logo">
</p>

[![Acknowledgement ITMO](https://raw.githubusercontent.com/aimclub/open-source-ops/43bb283758b43d75ec1df0a6bb4ae3eb20066323/badges/ITMO_badge.svg)](https://itmo.ru/)
[![Acknowledgement NCCR](https://raw.githubusercontent.com/aimclub/open-source-ops/43bb283758b43d75ec1df0a6bb4ae3eb20066323/badges/NCCR_badge.svg)](https://actcognitive.org/)
[![Mirror](https://img.shields.io/badge/mirror-GitLab-orange)](https://gitlab.actcognitive.org/itmo-nccr-code/fedot-llm)


FEDOT.LLM is an LLM-based prototype for next-generation AutoML. It combines the power of Large Language Models with automated machine learning techniques to enhance data analysis and pipeline building processes.

Expand Down Expand Up @@ -94,4 +98,14 @@ If you want to contribute or set up a development environment, you can use the p

This will set up a fully-featured development environment in a container, either in GitHub Codespaces or using VS Code's Dev Containers extension.

For more information see [`.devcontainer/README.md`](.devcontainer/README.md).
For more information see [`.devcontainer/README.md`](.devcontainer/README.md).

Funding
=======

This research is financially supported by the Foundation for
National Technology Initiative's Projects Support as a part of the roadmap
implementation for the development of the high-tech field of
Artificial Intelligence for the period up to 2030 (agreement 70-2021-00187)


866 changes: 866 additions & 0 deletions datasets/Handwriting/Handwriting_TEST.ts

Large diffs are not rendered by default.

166 changes: 166 additions & 0 deletions datasets/Handwriting/Handwriting_TRAIN.ts

Large diffs are not rendered by default.

41 changes: 0 additions & 41 deletions docker/Dockerfile

This file was deleted.

61 changes: 54 additions & 7 deletions docker/docker-compose.yml
Original file line number Diff line number Diff line change
@@ -1,11 +1,58 @@
version: '3'
name: fedotllm
services:
jupyter-fedotllm:
app:
build:
context: ../
dockerfile: docker/Dockerfile
context: ..
dockerfile: docker/run.Dockerfile
restart: always
container_name: fdlm-app
command: "tail -f /dev/null"
ports:
- "8800:8888"
- "8080:8080"
env_file:
- ../.env
platform: linux/amd64
volumes:
- ../:/home/fedya/work
- ../.cache/pip-docker:/home/fedya/.cache/pip
- ./docker_caches:/docker_caches
develop:
watch:
- action: sync
path: ../
target: /app
ignore:
- ../pyproject.toml
- ./
- action: rebuild
path: .
target: /app/docker
ignore:
- ./docker-compose.yml
- ./docker_caches
- ./dev.Dockerfile
- ./README.md
- action: rebuild
path: ../pyproject.toml
networks:
- fdlm-net
depends_on:
chromadb:
condition: service_started

chromadb:
image: chromadb/chroma
restart: always
container_name: fdlm-chroma
environment:
- IS_PERSISTENT=TRUE
- PERSIST_DIRECTORY="/docker_caches/chroma"
- ANONYMIZED_TELEMETRY=FALSE
volumes:
- ./docker_caches/chroma:/docker_caches/chroma
command: "--workers 1 --host 0.0.0.0 --port 8000 --proxy-headers --log-config chromadb/log_config.yml --timeout-keep-alive 30"
ports:
- 8000:8000
networks:
- fdlm-net

networks:
fdlm-net:
37 changes: 37 additions & 0 deletions docker/run.Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
FROM python:3.10-slim AS builder

RUN apt-get update && apt-get install \
--no-install-suggests \
--no-install-recommends \
-y \
build-essential \
curl \
python3-venv \
python3-pip \
&& rm -rf /var/lib/apt/lists/*

ENV PYTHONFAULTHANDLER=1 \
PYTHONUNBUFFERED=1 \
PYTHONHASHSEED=random \
PIP_NO_CACHE_DIR=off \
PIP_DISABLE_PIP_VERSION_CHECK=on \
PIP_DEFAULT_TIMEOUT=100 \
POETRY_NO_INTERACTION=1 \
POETRY_VIRTUALENVS_PATH=/app/venv\
POETRY_CACHE_DIR='/var/cache/pypoetry' \
POETRY_HOME='/usr/local' \
POETRY_VERSION=1.8.5

WORKDIR /app

RUN curl -sSL https://install.python-poetry.org | POETRY_VERSION=${POETRY_VERSION} python3 -

COPY poetry.lock pyproject.toml /app/

RUN poetry install --no-interaction --no-ansi

RUN SNIPPET="export PROMPT_COMMAND='history -a' && export HISTFILE=/docker_caches/.bash_history" \
&& echo "$SNIPPET" >> "/root/.bashrc"

COPY . .

7 changes: 3 additions & 4 deletions docker/.dockerignore → docker/run.Dockerfile.dockerignore
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
# Python virtual environment
../.venv
../venv


**/.env
**/.venv
**/venv
Loading
Loading