xeval

X-Plane evaluation kit

DATA Structure

Data   
│
└──
│  │
│  └─Airport
│    │
│    └─flight228
│      │
│      └─ X.csv
|      |  data_0.jpg
|      | ...
│      │
│      └─turbulence
│        └─ X.csv
│        │  target.csv
│        │  data_0.jpg
|        |  ...
│    │  ...
│
└──splits.json

Before Evaluation

Launch scripts/preparator.py to:

• get dataset feature size
• get supervised tasks names
• get action inds
• update configs:
  • update dataset path
  • generate benchmarks config

Splits

• Train - 45%
• Validation - 15%
• Test - 40%:
  • Train benchmarks 66%
  • Validation benchmarks 33%