Introduction
Setting Up
This page describes how to set up Dies for development.
Requirements
To compile the project all you need a recent version of stable Rust. We recommend using rustup to manage your Rust installation.
For development, you should make sure that rustfmt and clippy are installed. You can install them with rustup component add rustfmt clippy.
To use the ER-Force simulator, you will also need to install a recent version of Docker and ensure that the Docker daemon is running.
Building and Running
Dies uses cargo workspaces to manage its crates. The dies-cli crate contains the Dies CLI, which can be used to run matches.
To run tests for all crates, run cargo test in the root directory. You can run specific tests by specifying the crate name, eg. cargo test -p dies-core.
To run the CLI from the workspace root, use cargo run.
TODO: describe web UI.
Developer Guide
This document provides some guidelines for developing Dies.
Using Git
The main branch should remain stable at all times. All new features and fixes should be developed in feature branches, and merged into main only after they are complete and have been tested. Feature branches should be named <name of author>/<feature name>, eg. balint/fix-ersim-env-win.
The CI will run tests and formatting checks on all branches, but you should run these locally before pushing your changes.
Commit names should adhere to a lite version of the Conventional Commits spec, ie. they should follow the format: <commit type>: <short description>. Scopes are not needed. The commit type should be one of the following:
feat: new featurefix: bug fixrefactor: refactoringdocs: documentationtest: adding testschore: other changes (eg. CI, formatting, etc.)wip: work in progressmisc: other changes
Code Style
Dies uses the rustfmt formatter. It is recommended to use the rust-analyzer extension for VS Code, and configure it to automatically format the code on save.
We also use clippy for linting. The VS Code extension should also automatically run clippy on save.
In general, the Rust code should be idiomatic, and should attempt to follow the Rust API Guidelines.
Generics should be used with consideration. They are powerful, but they make the code more complex and significantly increase compile times. As a rule of thumb, remember YAGNI (you ain't gonna need it) -- don't overengineer, you can always add generics later if you need them.
Crate Structure
Dies is split into multiple crates. We use cargo workspaces to manage these. Having a lot of crates is not necessarily a bad thing -- crates are the unit of compilation in Rust, so more granular crates help caching and parallel compilation.
In general, the dependency graph between our crates should resemble a diamond:
+- feature crates -+
/ \
dies-core ------------> dies-cli
\ /
+- feature crates -+
There should be a few root crates (dies-core) which will rarely change, a number of specialized feature crates (dies-basestation-client, dies-executor, etc.), and a few small leaf crates which just glue things together (dies-cli).
For an up-to-date list of crates, see the README.
Error Handling
Errors should be handled according to Rust idioms. In general, we should avoid panicking, and instead propagate Result to the very top, where it can be handled by the executor.
Throughout the codebase, the anyhow crate should be used for error handling. Anwhow provides a convenient dynamic wrapper type for errors, so we do not have to define our own error types. anyhow::Result should be the return type of all functions which can fail.
Logging
Logging is really important for Dies, as it is the only way to debug issues that occured during a match. Logs should contain all the information needed to replay matches, including all the data we receive from the vision system, the world state, and the commands we send to the robots.
Dies uses the log crate for logging. The following log levels should be used:
error: should be used only for fatal errors, which cause the executor to stop, ie. errors should only be logged in the executorwarn: should be used for unexpected events or recoverable errors, which do not cause the executor to stop and do not get propagated upinfo: should be used rarely, only for information that the user needs to know while running Dies - for example when long operations start and finish, or when error-prone operations succeeddebug: should be used most of the time: everything from the data we receive from the vision system, commands we send to the robots, to all minor events should be logged at this level
We do not use trace.
println! and all other forms of direct output should be avoided, as they are not captured by the logger.
Testing
Reliability is very important for Dies, so we aim for high test coverage. All new features should come with corresponding unit tests. Unit tests should test the code located in the module they are in, and should avoid relying on other modules.
Property-based testing should be explored for testing the core logic of Dies. See the proptest crate for more details on this technique.
Documentation
This section is WIP.
Dies Architecture
Dies is Delft Mercurians' open source framework for building AIs, specifically the central team controller, for RoboCup Small Size League.
Dies runs on a central server, and communicates with the tournament software (ssl-vision/simulator, game controller), and with the robots on the field. It is responsible for running the AI, and for sending commands to the robots.
graph TD
GameController[/Game Controller/] <--> Dies
SSLVision[/SSL Vision/] --> Dies
Robots[/Robots/] <--> Dies
Framework Component Relationships
Legend
- A `*--` B: Ownership (A can only exist as part of B)
- A `o..` B: Aggregation (A owns B, but B can exist independently)
- A `<..` B: Dependency (A does not store B, but makes use of it)
classDiagram
%% Cli is the main entry point
Cli o.. WebUi
Cli o.. TestMainLoop
%% WebUi owns the main loops
WebUi o.. InteractiveMainLoop
WebUi o.. PlaybackMainLoop
%% Main components owned by TestMainLoop
TestMainLoop <.. Simulator
TestMainLoop <.. TeamMap
%% Main components owned by InteractiveMainLoop
InteractiveMainLoop <.. Simulator
InteractiveMainLoop <.. SslClient
InteractiveMainLoop <.. BsClient
InteractiveMainLoop <.. TeamMap
PlaybackMainLoop *-- Logplayer
%% TeamMap owns Teams
TeamMap *-- Team
%% Team owns core components
Team *-- Tracker
Team *-- TeamController
Team *-- StrategyServer
%% Tracker hierarchy
Tracker *-- PlayerTracker
Tracker *-- BallTracker
Tracker *-- GameStateTracker
%% Controller hierarchy
TeamController *-- PlayerController
PlayerController *-- RobotController
PlayerController *-- Skills
%% Skills collection
Skills o-- GoTo
Skills o-- Face
Skills o-- FetchBall
Skills o-- OrbitBall
Skills o-- Pass
Skills o-- Receive
%% Strategy client/server relationship
StrategyServer ..> StrategyApi : IPC
StrategyApi <-- StrategyClient
class Cli {
main()
}
class Skills {
<<collection>>
}
class StrategyServer {
<<IPC Server>>
}
class StrategyApi {
}
Data Flow
Interactive Mode (simulation or live)
flowchart TB
%% Define all components first
UI[Web UI]
WS[Web Server]
ML[Main Loop]
TR[Tracker]
CT[Controller]
SS[Strategy Server]
SA[Strategy API]
ST[Strategy Process]
SIM[Simulator]
SSL[SSL/BS Client]
TM[Team]
CLI[CLI]
%% Group the UI layer
subgraph UserInterface[User Interface]
UI
WS
CLI
end
%% Group the core system components
subgraph CoreSystem[Core]
ML
SIM
SSL
end
%% Group the team components
subgraph TeamSystem[Team]
TM
TR
CT
SS
end
%% Group the strategy components
subgraph StrategySystem[Strategy]
SA
ST
end
%% Now define all the connections
CLI -->|Config| WS
ML -->|Debug data & Status| WS
WS -->|Player Overrides| TM
WS <-->|Start/Stop| ML
UI <-->|UiMessages & UiData| WS
ML -->|Simulator Cmds| SIM
SSL -->|Vision/GC Updates| TR
SIM -->|Vision/GC Updates| TR
TR -->|Tracker Data| TM
TM -->|Tracker Data| CT
TM -->|Tracker Data| SS
SS -->|Team Cmds| CT
SS <--->|Team Cmds & Tracker Data| SA
SA <-->|IPC| ST
SSL <-->|Robot Cmds| CT
TR -->|World Frame| WS
Test Mode (automated)
flowchart TB
%% Main components - note the reduced set
TML[Test Main Loop]
TR[Tracker]
CT[Controller]
SS[Strategy Server]
SA[Strategy API]
ST[Strategy Process]
SIM[Simulator]
TM[Team]
%% Test configuration and control
TML -->|Test Scenario Commands| SIM
%% Simulated vision flow
SIM -->|Simulated Vision/GC Updates| TR
%% Tracker data flow - through team
TR -->|Tracker Data| TM
TM -->|Tracker Data| CT
TM -->|Tracker Data| SS
%% Strategy flow remains the same
SS -->|Team Cmds| CT
SS <-->|Team Cmds & Tracker Data| SA
SA <-->|IPC| ST
%% Robot control now goes directly to simulator
CT -->|Robot Commands| SIM
%% Add subgraph for test components
subgraph TestFramework[Test Framework]
TML
end
%% Add subgraph for team components
subgraph Team
TM
TR
CT
SS
end