SpaceYL/ECE_Poirot
First model merged on the ECE intelligence Lab proprietary GPUs
This model has been produced by:
- LALAIN Youri, engineering student at French Engineering School ECE
- RAGE LILIAN, engineering student at French Engineering School ECE
Under the supervision of:
- Andre-Louis Rochet, Lecturer at ECE, Co-founder at TW3 Partners
- Paul Lemaistre, Lecturer at ECE, CTO at TW3 Partners
- Mohammed Mounir, Solution Architect at Exaion
- Hervé Chibois, Infrastructure Expert at Exaion
- Des Bontés Sonafouo, Chef de projet IT at Omnes
With the contribution of:
- ECE engineering school as sponsor and financial contributor
- François STEPHAN as director of ECE
- Gérard REUS as acting director of iLAB
Supervisory structure
The iLab (intelligence Lab) is a structure created by the ECE and dedicated to artificial intelligence
About ECE
ECE, a multi-program, multi-campus, and multi-sector engineering school specializing in digital engineering, trains engineers and technology experts for the 21st century, capable of meeting the challenges of the dual digital and sustainable development revolutions.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: bond005/meno-tiny-0.1
layer_range: [0, 28]
- model: Qwen/Qwen2.5-1.5B-Instruct
layer_range: [0, 28]
merge_method: slerp
base_model: Qwen/Qwen2.5-1.5B-Instruct
parameters:
t:
- filter: self_attn
value: [0, 0.25, 0.5, 0.75, 1]
- filter: mlp
value: [1, 0.75, 0.5, 0.25, 0]
- value: 0.5
dtype: bfloat16