FAF/SCFA Replay Parser Library

Zeldafanboy

Lol "air".

Giebmasse

im need mass pls

Could be interesting seeing more replays parsed and data analyzed/presented.

meatontable

I have tested a python binding and it is OK. What kind of the data analyze do you want ?
Winning fraction? most killed fraction ? popular (unpopular) units ?

Nooby

@meatontable What information can you extract here?

Relationship of unit experemental built to winning in next 10 mins would be good

meatontable

Sorry for delay. I'm doing this for fun when I'm free. Of course, a detecting winning conditions is a good goal.

dragonite

Found this thread after ages to be here. Unbelievable. Guys, you're great!

Askaholic

After almost 3 years I have finally released another version of the rust crate, and CLI tool. I also published a new version of the python package which adds binary wheels for python 3.11 and 3.12, and removes support for python 3.7. Note, the version numbers happen to correspond between the rust/python packages but that is just coincidence, I have not updated the python library to use the new changes from the rust one yet.

Rust: https://crates.io/crates/faf-replay-parser/0.6.0
Python: https://pypi.org/project/faf-replay-parser/0.6.0/

What's new?

Many, many refactors to the API. If you wrote some rust code that used version 0.5.2 of the rust crate, you'll have to update some syntax to get it to work with 0.6.0. See the improved docs page for the new syntax.

For CLI users things you'll notice are:

The improvement to the command output is now released on 0.6.0
Some additional output like game title and game quality in fafreplay info
A new fafreplay info --raw option for dumping out the entire contents of the replay header
Better detection of file type which does not rely on the file extension
Some basic support for Supreme Commander 2 replays

Enjoy!

gorleg

This is pretty incredible! I've been wondering if you could theoretically train an AI on the incredible amount of supcom replays out there. To do this though you'd need more than just a list of orders; presumably you'd need things like each player's intel, unit counts and locations, current resources, and more. It doesn't look to me like this is available from the replay data, does that sound right? No idea if this is truly possible, just curious

Askaholic

That is correct. In order to figure out that information you’d have to run the replay through the actual game simulation (I.e. watch the replay). You could probably create some sort of mod that would dump that info out while the replay is running, but I’m not very familiar with that side of things. A mod like that might even exist already.

Nooby

I have created a mod that dumps unit information and economy information into the game log. It is on the vault called unit logger.

I created some python code that runs multiple instances of FAF at once on a linux server with this mod enabled and goers through a folder full of replays at high gamespeed generating this data.

I created a seperate python program to parse out the log into an unitfile displaying
"GameTick,Army,EntityId,UnitId,FractionComplete,Position.x,Position.y,Position.z,MaxHealth,Health,ShieldRatio,IsIdle,MassKilled"

and an economy file displaying
GameTick,Army,lastUseRequested.MASS,lastUseRequested.ENERGY,lastUseActual.MASS,lastUseActual.ENERGY,stored.MASS,stored.ENERGY,income.MASS,income.ENERGY,maxStorage.MASS,maxStorage.ENERGY,reclaimed.MASS,reclaimed.ENERGY

This was done a year ago or so. I have processed 659 replays creating 12GB of CSV files (compressed to ~ 300mb) of unit positions with time, player economies, and if players won or lost. From this data you can absolutley get insight into what units built at what time correlate to a win. If you would like this data please message me.

https://forum.faforever.com/topic/7746/unit-logger-mod?_=1756499882431