FAForever Forums
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Login

    [Rating] Inconsistency when drawing

    Scheduled Pinned Locked Moved General Discussion
    16 Posts 8 Posters 1.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • FichomF Offline
      Fichom
      last edited by Fichom

      Ok, that's a good reason. But couldn't a system that punishes such behavior be put in place? Like keep track for each player what maps they get and if they DC. If someone DCs >10 times from a particular map (and always on that map), but almost never from others, the likelihood of that not being on purpose is really low. Increase the "10" number to reduce chances of false positives.

      Or, could there be a detection system that sees who DCed, that person gets penalized, and the rest of the players don't. I understand it would be hard to pull maybe in 1v1 if a player comes up with some kind of DoS attack on the opponent, but in 2v2, 3v3 and 4v4... idk, 60 seconds feels like a safe bet game-wise (as in nothing really major can happen in the first 60 seconds).

      Edit:
      Like, I'm thinking how other games get around this issue. I'd assume a time-penalty system would work as well, but I feel such a system would probably punish willing players that just had an unlucky DC too much.

      1 Reply Last reply Reply Quote 0
      • P Offline
        PViddy
        last edited by

        Even when all players agree to a Draw, there is still a rating change for TMM? I've experienced the same thing, and was surprised.
        How can you determine a winner/loser if it was a Draw?

        But then I checked the games a day later, and they correctly say 'DRAW' and no rating change.
        So it all worked out in the end, but that is a bit a confusing!

        Fichom - Have you rechecked the game results a day or two later? They may correctly appear as a Draw.

        Brutus5000B FichomF 2 Replies Last reply Reply Quote 0
        • AskaholicA Offline
          Askaholic
          last edited by

          Of course there “could” be but who is going to have time to build that. Detecting who is causing connection issues is also quite difficult and sometimes impossible since how can you decide which end of the pipe is responsible for the connection issue in a peer-to-peer system? That’s assuming you can even see which connections are having issues, which the lobby server can’t. I think nowadays the telemetry server often has that data and you could conceivably send it to the lobby server but there’s yet another nontrivial piece of code someone’s gotta write. All’s to say, yea it’s possible if you got enough devs with enough spare time.

          1 Reply Last reply Reply Quote 0
          • Brutus5000B Offline
            Brutus5000 FAF Server Admin @PViddy
            last edited by

            @pviddy said in [Rating] Inconsistency when drawing:

            Even when all players agree to a Draw, there is still a rating change for TMM? I've experienced the same thing, and was surprised.
            How can you determine a winner/loser if it was a Draw?

            Wrong assumptions on your end. A draw can cause rating changes and win of one player might - in theory - not cause a rating change. This depends on what the expected result is.
            The rating we should is just a simplified number of the underlying metrics mean (your assumed skill) and the deviation (the probability or confidence your mean is correct).
            We calculate the shown rating as rating = mean - 3*deviation.

            So if the mean doesn't change because the game predicted this result (and a draw could also be predicted!), the deviation might still be reduced because we are more sure, that the mean matches the true players skill.

            And I would still love somebody to build a trueskill calculator to explain this to people in a way they can play around with the values and see themselves.

            He said, "I've been to the year 3000
            Not much has changed, but they live underwater
            And your great-great-great-granddaughter
            Is playin' FAF, playin' FAF"

            1 Reply Last reply Reply Quote 0
            • N Offline
              Nomander
              last edited by

              How about not rating matchmaker games if they result in a draw before the same grace period as in custom games?

              1 Reply Last reply Reply Quote 0
              • BlackYpsB Offline
                BlackYps
                last edited by

                You mean like this? https://github.com/FAForever/server/issues/948

                1 Reply Last reply Reply Quote 0
                • N Offline
                  Nomander
                  last edited by

                  Pretty much. Your idea in the issue is to not rank games ended by a draw, and I want to add on top of that the grace period condition.

                  As for the rating manipulation possibilities mentioned there:

                  • In 1v1, draw should never derank because connection issues aren't frequent enough.
                  • In team games, imo there are enough participants for someone to make a report against people who leave when they don't like their opponents/the map, and the unranked draw would be relieving for many players who get connection issues.
                  1 Reply Last reply Reply Quote 0
                  • BanthaFodderB Offline
                    BanthaFodder
                    last edited by

                    TMM games, like all global games should be unrated within that first 8 minutes.

                    Regardless of who is "expected" to win.

                    Surely that is easy to change. Apply this rule after 8 minutes.

                    It's plain stupid that rating changes occur during any kind of draw. It defies the definition of the word draw.

                    1 Reply Last reply Reply Quote -2
                    • FichomF Offline
                      Fichom @PViddy
                      last edited by

                      @pviddy That's because of the most recent client update that now doesn't show rating changes in matchmaker games at all. The change still happens, you just don't get informed on it 😉

                      1 Reply Last reply Reply Quote 0
                      • FichomF Offline
                        Fichom @FtXCommando
                        last edited by

                        This post is deleted!
                        1 Reply Last reply Reply Quote 0
                        • FichomF Offline
                          Fichom @FtXCommando
                          last edited by

                          @ftxcommando I forgot to add, which is quite important: that is a valid reason. But, at least the Draw mechanic should have a timeout so it's unrated for a sufficiently short games.

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post