Your opinion about maps with map-wide assets

@harzer99

I cannot produce the same results. Using dxt1 turns one of the decals from ~22mb to ~11mb, and DXT3 appears to have no impact on the file size. What tool did you use to generate those files? I used Photoshop with the Nvidia DDS plugin and ImageMagick - both have similar results.

7880a55c-7610-409d-ba00-1650b45ce084-image.png

(note: these assets are 4k as they are used during production. Final would be 8k and ~4x the file size)

edit: the game does appear to support the format - so please do inform how you made them 🙂

A work of art is never finished, merely abandoned

@Sheikah I am not sure if I agree with your reasoning, for me it seems that most issues come from the fact that people don't have a map downloaded and then they take too long to download it when a match is found. Forcing a player to download all of the maps would solve this issue and you can treat the map downloads as something like a monthly update that you need to get in order to play. Considering that 1/4 of the maps stay the same in between rotations and the map pools for lower rated people are small it would be <400 MB which I don't think is unreasonable these days. Another problem it would fix would be the possibility to dodge certain maps on 1vs1 and TMM because you can just cancel the download of the map you don't want to play and re queue.

@Tagada The issue is that for some subset of players the download takes so long and also consistently fails. So forcing them to have to download the map beforehand would effectively lock them out of the matchmaker.

Also there is no way to cancel the download of the map outside of just closing your client.

Well, if it takes long then it doesn't matter if they will need to download the map before queuing or after they've found a match. With the first option at least it doesn't give the impression that the matching doesn't work for players and it also doesn't harm other players. As for not being able to download the maps at all then I suppose you could add a note that if the map download fails then you can go into map list and download the map manually? If a player isn't able to download the maps in any way then they can't play the queue anyways right? If you would allow the players to play only on the maps they can download you will harm the accuracy of the ladder rating as well.
I fail to see how forcing an upfront download will harm any user experience, it makes sure everything should work before letting you play and it also allows you to download the maps when you are away from a PC if you have slow internet connection so that you no longer need to worry that the other person will cancel a match because you are taking so long to download the maps.

In the cases I am talking about even the manual download fails. And it is not the issue that they can't download any map it is that they specifically cannot download these large file size maps only. Which would lock them out of the queue just because of one map that they may not even play on.

Well, you shouldn't be allowed to play ladder if you are just gonna skip some maps, it also harms other user experience since if they match on the map that user A can't download then user B will be just stuck on Automatch. If the download fails consistently then either the server you are downloading from has some issues or it stops downloading when you loose connection or something else but even with really slow internet connection if you give it some time the download will finish, after all they've downloaded the game which is a couple GB right?

They are not actively skipping the maps because they want to. And I am not sure why it freezes for some users on downloading these maps specifically when other things are fine but it does occur and I cannot really fault the user for that and then prevent them from playing.

Note that in the future when a match cancelled message is received because of a timeout by one of the players the client will automatically close the game for you.

Well, perhaps the solution is to have a window pop up that says : You don't have all the maps downloaded. Have a button to download all maps but also a button saying Queue anyways or something like that. But in the end this complicates the system and even if it sucks for a very few players the best solution imo for all the players is to force the download of all maps before allowing someone to queue. That's how other games operate as well. It's kind of like if you can't download an update for the game you can't play the game. Ofc it's worth investigating why the map download fails in the first place.
I don't think that we should exclude the maps that undoubtedly look better and are an awesome break through in the mapping scene because few people can't seem to be able to download them. 300-400 MB monthly is not that much after all.

@jip said in Your opinion about maps with map-wide assets:

@sheikah Are they compressed, or stored as a zip folder? I recall windows having an 'add to zip' which is essentially just the map in a file, with no compression.

When I use 7zip on Kaali I get these results:

  • unzipped: 258 mb
  • zipped: 158 mb
  • 7z: 130 mb

They are compressed for example the Kaali currently on the server is 137 MB to download and 200MB once unzipped.

@jip said in Your opinion about maps with map-wide assets:

@valki said in Your opinion about maps with map-wide assets:

If those decals don't matter for gameplay, is it possible for one player to play without the decals while the other does?
In that case, make a normal and high res version of each map where the latter has no or small size decals.
Automatcher only ever downloads normal versions. With a button you can download all high res maps at once.

This was a potential solution I was thinking of too. I provide the maps in the vault with low-quality assets and you can manually replace them with high-quality assets. You could even go up to 16K per texture (that is 300mb / texture) and Supreme Commander would bite, looks brilliant.

I was wondering about this sort of thing as well. If this is viable, perhaps there might be a good way to automate this process either based on connection speed (which could be gauged by the download times for regular maps) or by an in-client option to download low or high data map versions for maps that have both available (low could be the default). Any thoughts on the viability of coding this approach? @Sheikah @Askaholic

pfp credit to gieb

@emperor_penguin said in Your opinion about maps with map-wide assets:

@jip said in Your opinion about maps with map-wide assets:

@valki said in Your opinion about maps with map-wide assets:

If those decals don't matter for gameplay, is it possible for one player to play without the decals while the other does?
In that case, make a normal and high res version of each map where the latter has no or small size decals.
Automatcher only ever downloads normal versions. With a button you can download all high res maps at once.

This was a potential solution I was thinking of too. I provide the maps in the vault with low-quality assets and you can manually replace them with high-quality assets. You could even go up to 16K per texture (that is 300mb / texture) and Supreme Commander would bite, looks brilliant.

I was wondering about this sort of thing as well. If this is viable, perhaps there might be a good way to automate this process either based on connection speed (which could be gauged by the download times for regular maps) or by an in-client option to download low or high data map versions for maps that have both available (low could be the default). Any thoughts on the viability of coding this approach?

I think automating it is too much effort for the niche case that we're talking about. Svenni and me are essentially the only two people that actively use custom assets in maps and then you can take Svenni off the list because he sticks to 4k instead of 8k.

To me this would be as simple as having a check in the map to see if a certain file in the map folder exists, if it doesn't then I can assume that they're using the default (low-res) textures. I could make a decal or a message somewhere that says you can download the high-res textures somewhere else.

That location in turn would be something similar to Google Drive that supports large files. I can automate the entire process so that both 4k, 8k and 16k files are available for you to choose from. Including instructions on how to replace them.

@Tagada I think it is important not to exclude people from the matchmaker in any form. If people have issues downloading assets then that is on us to fix. Or to leave the assets out. That is also why one of the questions is whether these maps are fit for ladder / tmm - as there you don't get to decide what to play.

@harzer99 I'm going to look into using Gimp for the task.

I'd like to note that this has been quite a productive discussion thus far, keep it coming.

A work of art is never finished, merely abandoned

@sheikah said in Your opinion about maps with map-wide assets:

The issue is that for some subset of players the download takes so long and also consistently fails

The solution is probably to download the files in chunks. I have no idea how difficult that would be to implement in java, e.g. if free pre-written code already exists for it. This is something that I like about Steam. The download can stop at any time and start up later, no problems.

Consider the following:
You get a match and the map download starts. You have no way of knowing that this map has map wide decals and an enormous file size. You might not even be aware that this concept exists at all. Now you notice that the map download takes much longer than expected. You may now miss your match, maybe you even close the client to "fix" the problem. This can leave you with a broken map, because the half loaded image leaves the map in a broken state. This has already happened and it will happen again in the future.

Because of this I would like to see the file sizes of maps in the matchmaker map pools to stay roughly in the same order of magnitude. The path to have the people manually "upgrade" the map visuals seems worthy to explore further.

Some random thoughts:
We could have a version with and without the decals in the vault. One that is in the matchmaker and one so people can easily install the "pretty" version for custom games and so they can have a look at what they are potentially missing. Not everyone is confident to manually swap files in their folders.

It has already been dicussed why forcing all map downloads is not feasible, I just want to add: It would not only happen once a month, but also everytime you unlock a bigger pool size, which can happen anytime.

Something to encourage people to download the map pool beforehand would indeed be cool. Maybe an element under the map pool button that notifies you that you are missing maps and gives you the option to download them all with a single click. Maybe I'll look into it once I finished the matchmaker and league projects.

Lastly: I really like the visuals of your maps and how you are pushing the boundaries. Keep them coming!

I skimmed through this so apologies if I missed some more conversation around this, but I like the suggestion @Valki proposed about having an option to toggle between low and high res versions of the maps. It sounds like it's not feasible to automate that for how few maps will be impacted, but what @Jip said about making a decal and giving the people the option to do it manually sounds like a nice compromise there.

I'm also still not seeing the issue with having people be forced to download the maps before queuing. It's the difference between making it annoying for the handful of people that might be impacted vs every single person they try to queue with and the queue fails, which I feel has been happening more recently. The maps have to be downloaded regardless, how do data cap issues come into play there? I suppose it's different if they're just playing a couple games there's a chance there's less of a total download size, but not for anyone playing a lot of ladder/tmm. If it fails for them to download before queueing, it'll also fail during queuing which is a worse experience for more people. Maps are reused a ton throughout the pools. Do that for two or three pools and they'd have most of the maps for ladder/tmm anyway, and this would be coupled with the lower res download set.

Also, how hard would it be to implement what @arma473 is suggesting to improve the downloads?

@emperor_penguin said in [Your opinion about maps with map-wide assets]

I was wondering about this sort of thing as well. If this is viable, perhaps there might be a good way to automate this process either based on connection speed (which could be gauged by the download times for regular maps) or by an in-client option to download low or high data map versions for maps that have both available (low could be the default). Any thoughts on the viability of coding this approach? @Sheikah @Askaholic

This would effectively require a pretty major overhaul of the versioning system we have currently have in the db, the api, and the client itself. It would also require testing to ensure there would be no desyncs. Also a would have to figure out how to handle the name conflicts between maps on the content server. All in all a lot of work for a very niche use case. So imo not likely to happen.

@arma473 said in Your opinion about maps with map-wide assets:

The solution is probably to download the files in chunks. I have no idea how difficult that would be to implement in java, e.g. if free pre-written code already exists for it. This is something that I like about Steam. The download can stop at any time and start up later, no problems.

This would require turning downloads into a true background task that would continue even if the client were closed. It also doesn't necessarily solve the issue as people still would not be able to join a queue or game until the download had finished fully.

@exselsior said in Your opinion about maps with map-wide assets:

I'm also still not seeing the issue with having people be forced to download the maps before queuing.

The issue boils down to the fact that the chance that you get one of these troublesome maps is rather low when you queue and so it would be bad to lock someone out of the queue just because one map in the queue has an issue for them when they may not even ever play it in the queue.

@sheikah said in Your opinion about maps with map-wide assets:

@exselsior said in Your opinion about maps with map-wide assets:

I'm also still not seeing the issue with having people be forced to download the maps before queuing.

The issue boils down to the fact that the chance that you get one of these troublesome maps is rather low when you queue and so it would be bad to lock someone out of the queue just because one map in the queue has an issue for them when they may not even ever play it in the queue.

That's where the low res version of the troublesome maps comes into play. Low res version should solve the issue of the larger downloads failing and bring them more inline with the size of the other maps. Now when they queue they don't have this awkward long wait for them to download any new maps before a match starts which helps mitigate one aspect of the issue of matches just not starting.