News:

most Recent Posts and Recent Topics now viewable on the front page!

Main Menu

The Old Dice Controversy

Started by guilessa, November 10, 2011, 03:26:51 PM

Previous topic - Next topic

guilessa

I know how annoying it can be to have to listen to so many complaints about FIBS dice. Personally, I don't have a problem with them and enjoy the games without constant paranoia.

Nevertheless, I want to report some matches I've been playing against FIBS bots, especially the stronger ones such as Monte Carlo, GammonBot_V etc.

In recent games, I put those games (not so many to be a definitive ) into GNUbg and the bot was getting about 25% of doubles, when we know that the average number for doubles is 16,66% of total rolls. Either that, or it gives me "bad dice, man", in GNUbg's own words.

This reminded me of a friend who used to contend that stronger bots roll better dice (or you roll worst dice) and that's the main reason which makes them strong. Anyway, I will continue to play matches against them, losing my precious points, and once I compile a more expressive number of games, I will post them here.

Maybe I'm wrong, but it annoyed me so much that I had to post. Sorry for the inconvenience of bringing up this old boring issue. But I just had to.

Cheers!

diane

There are two things you should do before continuing on with your plan to post more games here...

1 - read this thread..[all of it, no skipping  ;) ]

http://www.fibsboard.com/fibsboard-forum-matches/how-do-'luck'-calculations-work/

2 - Ensure you analyse the games you win too - and look for unusual rolling sequences by you in matches you win. My immediate guess would be that sometimes they get lucky, sometimes you get lucky, but they play better so they do better with the luck they get.

Over all the games, the doubles rolled out will tend towards 16%, but it will take a lot of matches to see that. Some will be 22% and some will be 3 %, some will be 50% and some will be 10%...all of these are possible, and not indicative of anything unusual going on.

You can also play much longer matches, 13 points as a minimum. The longer they are, the less the rolls will seem one sided. You may well still see the bots analysing as lucky - when you read that thread, you will see why.
Never give up on the things that make you smile

dorbel

As Diane points out, almost any number of doubles is possible in a match. The match where 1/6th of the rolls are doubles will be a rarity. However, if you want to collect stats, it's no use saying, "Hey the bots seem to have been getting a lot of doubles recently" and then when you look back, surprise, surprise, they have been getting more than average. You have to be scientific and start from scratch. You need to look at a minimum of ten thousand rolls before things start to even out.
You may like to know that the fibs dice have been tested and the server itself keeps running stats which you can see for yourself with the dicetest command. The bots get their dice from the server, just like you, so their average will be the same as yours. Interestingly, the stats show that doublets are slightly under what they should be. This is because when the server rolls a doublet on the first roll of a game, it junks it and rolls again. 5-2 is currently the most common roll.

moonshadow

#3
The topic of whether FIBS dice are random or not usually brings out the crazies so its nice to see guilessa working through the issues with logic instead of paranoia and hysteria.

However, there really is no need to keep track of your matches or do any other experiments in order to determine if FIBS dice rolls are truly random, because this has already been done.

In 1997 Stephen Turner, after an impressive analysis of 10,593,121 rolls of FIBS dice, concluded that "FIBS dice appear fair" and that, "the number of doubles in the sample was 1,763,911, or 16.651%, fractionally less than expected, but well within normal statistical variation."

Keep this link handy: http://www.bkgm.com/rgb/rgb.cgi?view+262

When I'm playing a whining dimwit who claims "FIBS dice are fixed!" i just give them this link in the faint hope they will see the light, though more often than not, they lack the intelligence to be able to comprehend what they are reading and end up disagreeing with something they don't even understand.

Turner is (or at least was in 1997) a professional statistician at the University of Cambridge Statistical Laboratory and used to be an avid backgammon player (I believe he had one of the first sites devoted to backgammon in the early days of the Internet), so if he says FIBS dice are truly random after having analyzed 10,593,121 rolls, I would call that pretty conclusive.

Did that number sink in? That's ten million five hundred ninety three thousand one hundred twenty-one.

Turner sums up the randomness of FIBS dice issue thusly:
QuoteI can supply the data on request, but the chi-squared statistic gave an answer of -0.355521, showing no evidence of bias. As I said above, this test will check both whether some rolls come up more than others, and whether some rolls are more likely than others to come up after specific rolls. As a check, the number of doubles in the sample was 1763911, or16.651%, fractionally less than expected, but well within normal statistical variation (1.32 s.d.s from the mean, in fact).

If you carefully read Turner's analysis you will see that these 10,593,121 are all rolls generated by the FIBS server, including the first rolls of a match which happen to be doublets. Turner evidently used the undocumented and mysterious "matrix" command (go ahead, try it!) to compile this data. dorbel's concern that the data would be skewed due to first roll doublets doesn't apply here--perhaps he is alluding to the skewed data derived from the old Big Brother matches, which did not include first roll doublets.
 
In any case, next time someone is looking for hard data on FIBS dice, point them to Turner's study.

diane

Quote from: moonshadow on November 11, 2011, 03:30:44 AMIn any case, next time someone is looking for hard data on FIBS dice, point them to Turner's study.

I have that page bookmarked for such moments  ;)
Never give up on the things that make you smile

guilessa

Ok, guys. Thanks for all the prompt responses. I'll take all you said into account.

Diane, I read the thread you recommended, but not all the 5+ pages  ;) The first one was enough for me.

Thanks, moonshadow, for acknowledging that I'm not trying to make a point out of nothing.   

If I have any data that I think should be considered, I'll post it.

Thanks a lot for the attention.

Cheers




diane

Quote from: guilessa on November 11, 2011, 02:20:39 PMDiane, I read the thread you recommended, but not all the 5+ pages  ;) The first one was enough for me.

The conclusion is the important part...the better you play, the more you will tend to appear lucky in a match analysis - so the observations that bots are lucky more often on analysis is a function of how well they play, rather than that they get more of the random luck on offer...
Never give up on the things that make you smile

pck

Quote from: moonshadow on November 11, 2011, 03:30:44 AM
In 1997 Stephen Turner, after an impressive analysis of 10,593,121 rolls of FIBS dice, concluded that "FIBS dice appear fair" and that, "the number of doubles in the sample was 1,763,911, or 16.651%, fractionally less than expected, but well within normal statistical variation."
[...]
Turner is (or at least was in 1997) a professional statistician at the University of Cambridge Statistical Laboratory and used to be an avid backgammon player (I believe he had one of the first sites devoted to backgammon in the early days of the Internet), so if he says FIBS dice are truly random after having analyzed 10,593,121 rolls, I would call that pretty conclusive.

Did that number sink in? That's ten million five hundred ninety three thousand one hundred twenty-one.

Pointing to serverwide statistics isn't as strong an argument against allegations of manipulation as it may seem.

Imagine the following scenario: Unbiased dice generator (DG), exactly two players are logged into fibs. Fibs is programmed to behave in the following way: If on player 1's turn the DG rolls a 66, the roll is put on hold and instead the player is given the next roll produced by the DG (if that happens to be a 66 as well, the process is iterated until one of the other 35 rolls comes up). The 66(s) is(are) given to player 2 on her next turn(s). Result: Non-random dice sequences for both players, while any serverwide stats like dicetest will detect no bias, no matter how large the the number of rolls.

This scenario is modifiable in many ways and extensible to an arbitrary number of players.

moonshadow

#8
Quote from: pck on November 21, 2011, 10:16:32 AM
Pointing to serverwide statistics isn't as strong an argument against allegations of manipulation as it may seem.

What you are really suggesting--and all without any evidence or motive--is that in 1992 Andreas Schneider (aka marvin) intentionally programmed the FIBS software to diabolically "manipulate dice" and then foisted that off on the public on July 19th of that year.

What happened is that in your rush to brush aside and casually dismiss what you thought to be a sophomoric argument presented by statistician Turner's analysis, you perhaps hadn't fully read the article which I had linked but not quoted, or perhaps you read it, but not truly comprehended it.

Quote from: pck on November 21, 2011, 10:16:32 AM
Imagine the following scenario: Unbiased dice generator (DG), exactly two players are logged into fibs. Fibs is programmed to behave in the following way: If on player 1's turn the DG rolls a 66, the roll is put on hold and instead the player is given the next roll produced by the DG (if that happens to be a 66 as well, the process is iterated until one of the other 35 rolls comes up). The 66(s) is(are) given to player 2 on her next turn(s). Result: Non-random dice sequences for both players, while any serverwide stats like dicetest will detect no bias, no matter how large the the number of rolls.

Though intellectually stimulating, there is no need to tax our brains with this scenario.

I don't think you understand the matrix command that Turner used to collect his 10,593,121 FIBS dice rolls and to which I also alluded in my previous post. In his analysis of FIBS dice Turner says of the matrix command which was used to collect the data:
Quote
You probably don't know about this command because it's not on the list of commands, but it produces data not only on the frequency of rolls, but on the frequency of each of the possible 1296 possible pairs of consecutive rolls.

(Bold added for emphasis)

fergy, graphic designer of the old MacFibs interface and the GamesGrid (now Grid Gammon) graphics and who still occasionally plays here puts it thusly:

   
Quote•   Syntax: matrix
   

Display matrix of conditional roll frequencies. The matrix command shows you for each of the 36 possible combinations of numbers on the dice, the distribution of the next roll. For each of the 36 possible outcomes you'll see a matrix showing you how often each pair of numbers was rolled after that outcome. The numbers in the matrix represent the following rolls:


   •     1-1 1-2 1-3 1-4 1-5 1-6
   •     2-1 2-2 2-3 2-4 2-5 2-6
   •     3-1 3-2 3-3 3-4 3-5 3-6
   •     4-1 4-2 4-3 4-4 4-5 4-6
   •     5-1 5-2 5-3 5-4 5-5 5-6
   •     6-1 6-2 6-3 6-4 6-5 6-6 (X-X)


The last number shows how often a double was rolled after the given outcome. At the end of the list you'll also be told how often it has happened that a double was immediately followed by another double, together with Theoretical value for that number.
The values used for this test are all rolls that FIBS has made since it was last restarted. If the number of rolls is very small (i.e. smaller than 250000) the output of this command might lead you to wrong conclusions.
http://www.fibs.com/~fergy/help/fibsCommands/pages/matrix.html

So I think its quite reasonable to say that pointing to server wide statistics, especially those generated by the matrix command, provide a much stronger argument against dice manipulation than pck would suggest and that Turner's analysis of 10,593,121 rolls of FIBS dice, though not conclusive, is certainly far more compelling by an order of several magnitudes than that of any utterance by a caterwauling dice whiner.

For me, the most compelling argument against FIBs being programed to manipulate dice is that there is absolutely no evidence that Marvin did this and there is absolutely no motivation for him to have done so.

Fifteen years ago in 1996, several months before Turner completed his analysis of 10,593,121 FIBS dice rolls, Kit Woolsey modestly gives the reasons why his opinion should carry some weight:

QuoteThere has been much discussion on r.g.b. about the possibility of the FIBS dice being skewed, so I thought I should put in my two cents worth.

I have been playing on FIBS for about three years, and have logged plenty of experience points.  It is my personal judgment from my playing experience that the dice are not biased in any way.

How qualified am I to make such a judgment?  I have been playing backgammon for over 30 years, both money play and tournaments.  In addition I have been active in many other gaming activities which involve chance all my life.

When one is involved in gambling, there is always the danger of cheating.  It is important to be on the lookout for irregular occurrences, and to distinguish them from the normal lucky and unlucky sequences which will always happen.  On more than one occasion I have sensed that things weren't right, and walked away from a situation which could have cost me a lot of money had I stuck around.  Thus, from my experiences in the gaming world, I believe my judgment in this area is better than most people's judgment.

Kit goes on to address the point I made earlier that there is absolutely no reason for Marvin to have rigged the dice:

QuoteThe claim that the dice are intentionally programmed to be rigged in some way is patently absurd.  What would marvin's motivation be?  He has no profit from FIBS.  He created the program because he enjoys backgammon and wanted a free backgammon server to be available on the net.  In addition, programming the dice to be rigged is much more difficult than programming random dice.  Any such assumption about the dice being intentionally programmed to be rigged is completely contrary to logic.

(For Kit's full post from October 16, 1996, go here: http://www.bkgm.com/rgb/rgb.cgi?view+52)

As I understand it, it was Kit and his wife Sally that initially paid the FIBS server costs.

Overall, I suspect that pck regards this discussion of FIBS dice to be more of an intellectual puzzle than he is convinced there is outright dice manipulation and conspiracy, but in the event he gets too carried away with attributing sinister motives to Marvin and dice conspiracy theories,  I have Ockham's chainsaw ready.

diane

Quote from: moonshadow on November 28, 2011, 01:29:37 AMOverall, I suspect that pck regards this discussion of FIBS dice to be more of an intellectual puzzle than he is convinced there is outright dice manipulation and conspiracy, but in the event he gets too carried away with attributing sinister motives to Marvin and dice conspiracy theories,  I have Ockham's chainsaw ready.

I actually don't think for one moment that pck thinks there is any bias, or that anything untoward going on with regard to dice at fibs. I think his/her only issues are with the strength and nature of the arguments used to prove that they aren't. For each 'proof' offered that all is well, pck offers some rationale for that proof to be flawed. I have never heard an allegation that the proof is flawed because the dice are biased/skewed.

I am definitely going with the 'intellectual puzzle' theory :)
Never give up on the things that make you smile

Slipshod

Moonshadow,

Pck is not suggesting Marvin intentionally programmed the dice in a manner that would introduce bias. Anytime someone codes a software program there is the possibility of unintended consequences. Actually, we might not be incorrect in saying everytime someone develops complex code without rigorous code reviews and extensive testing, unintended consequences are virtually assured.

Turner's statistics are accurate and Pck knows that; Pck is pointing out that a Chi square test for all rolls is not necessarily a perfectly accurate test to eliminate the possibility of bias of all types. That is, a bias which is not solely attributable to random number generation. In this instance the Chi test is asking the question is the observed distribution of numbers consistent with a random distribution of numbers? The answer is clearly yes (although I will deny this the next time those cheating bots out roll me).

It is, of course, highly probable that there is no bias whatsoever in FIBS dice. However, that is an entirely different issue as to whether or not there is a rigorous proof of the same. I haven't read Turner's analysis so I can't comment on precisely what it was he set out to prove.

Pck's statment is accurate; Turner's data and statistical calculations are accurate; an accurate and careful use of language is difficult.

pck

#11
Quote from: moonshadow on November 28, 2011, 01:29:37 AM
What you are really suggesting--and all without any evidence or motive--is that in 1992 Andreas Schneider (aka marvin) intentionally programmed the FIBS software to diabolically "manipulate dice" and then foisted that off on the public on July 19th of that year.

What happened is that in your rush to brush aside and casually dismiss what you thought to be a sophomoric argument presented by statistician Turner's analysis, you perhaps hadn't fully read the article which I had linked but not quoted, or perhaps you read it, but not truly comprehended it.
Looks like I might have to reconsider my belief that vic is the fibster with the highest bp.

Quote from: moonshadow on November 28, 2011, 01:29:37 AM
Though intellectually stimulating, there is no need to tax our brains with this scenario.
Most of what I need to reply here has already been said by diane and Slip. My motivation was indeed to show that both sides of the dice manipulation debate have their weaknesses. Nothing more, nothing less. While it can get mathematically complex, the hardest part of statistics is interpretation. In the case of FIBS dice it amounts to considering what constitutes a proper test for manipulation and what doesn't.

Quote from: moonshadow on November 28, 2011, 01:29:37 AM
Overall, I suspect that pck regards this discussion of FIBS dice to be more of an intellectual puzzle than he is convinced there is outright dice manipulation and conspiracy, but in the event he gets too carried away with attributing sinister motives to Marvin and dice conspiracy theories,  I have Ockham's chainsaw ready.
While on the subject of attributing sinister motives, look at my ficticious manipulation scenario as a napkin that wipes the smug smile off the faces of those whose arguments carry insufficient clout. You don't always need a chainsaw to restore logical balance. (And btw, the logical weight of Ockham's principle is zero.)

I've never been much interested in intellectual puzzles. What gets my interest are conceptual problems and analyses, and randomness and probabilty are perhaps the hardest ideas a mathematician gets to wrestle with conceptually.

I've attached a pdf and two jpegs with an eXtremeGammon (XG) analysis of 120.000 of my and my opponents' rolls on FIBS (about 1100 matches, carried out by gumpi about two years ago; I do not have XG). On the last page of the pdf (which is also shown in pck_X2_dist.jpg) you'll find the result of XG's chi squared (X2) test. My opponents' dice can be viewed as representing the server since I played many different people (and bots). You'll note that my opponents' X2 turned out fine, while mine sucks, indicating that my rolls were rather far away from what can be expected from a random dice generator. What does this mean? pck_luck_skill_stats.jpg shows that my total luck over all these matches was pretty much exactly zero. This rules out the interpretation that the server "had it in for me" and in fact is a much better counter against accusations of fixed matches than the serverwide "dicetest" or "matrix" commands. So what I got were "crazy dice", but not "fixed dice". This is a distinction that hadn't even occured to me until I started thinking about randomness as a concept and gumpi being kind enough to provide me with this analysis. I have certainly never seen it even casually mentioned in any debate about rigged dice.

Asking myself how it is even possible to have serverwide stats which are fine but nonetheless skewed for an individual player is part of the covert and sinister history behind my posting above. The simple manipulation scenario I described is consistent with my X2 results, but what clears FIBS of suspicions concerning fixed dice (with respect to backgammon) is my luck.

dorbel

You don't need all the maths and computer tests do you? I think that all you need to ask is, "Are there any numbers on my next roll that are more likely to appear than probability suggests?" If the answer is no, then you have random dice. If on the other hand the answer is yes then you don't. I invite anybody who thinks that fibs dice are not random in any particular scenario (dice for a bot in a race for example) to bet real money on the outcome. I won't hold my breath while I wait for a response.

pck

#13
Quote from: dorbel on November 28, 2011, 10:58:00 AM
You don't need all the maths and computer tests do you? I think that all you need to ask is, "Are there any numbers on my next roll that are more likely to appear than probability suggests?"
That, in fact, is part of what a chi squared test (and the matrix command) does. It's of course possible, but tedious, to do this without a computer if you're looking at a couple of thousand or more rolls.

Do we need the math? Yes. Consider a dice generator which puts out this sequence (spaces and linebreaks are for ease of reading, only one die is being rolled, not two):

11 12 13 14 15 16
21 22 23 24 25 26
31 32 33 34 35 36
41 42 43 44 45 46
51 52 53 54 55 56
61 62 63 64 65 66
<repeat from beginning>

This passes the test your question asks for, but is as non-random as it gets. (The equivalent sequence for two dice is a 36x36 matrix with all possible combinations of two rolls, you get the idea.)

What makes a sequence of dice random is the absence of patterns. Patterns equal predictability, and predictability is the opposite of randomness. Since there are infinitely many different patterns which might occur in a dice sequence, it is impossible to have a perfect test for randomness.

Even putting it like that is a bit sloppy. Strictly speaking, any finite sequence of rolls is a pattern, which means that the idea of "patternlessness" can really only be applied to infinite sequences. Since actual infinite sequences of rolls are not available, but most dice generators use algorithms to create their output (*), the question of predictability becomes one of analysing a given algorithm for patterns. This can be attempted directly by mathematical argument or empirically by performing tests such as chi squared on samples of the algorithm's output. This is technically and conceptually challenging territory on which there is no unanimous agreement even among professionals.

---

(*) The alternative would be additional hardware which conducts actual experiments with random outcome, or software using other (hopefully) non-predictable data, for example from the internet.

inim

#14
QuoteMy motivation was indeed to show that both sides of the dice manipulation debate have their weaknesses.

What two sides of what debate? So far not a single piece of evidence was presented that the dice are manipulated. What is presented is a lot of conspiracy theory how they MIGHT be manipulated and how that may be hidden by a malevolent admin. How bizarre, how bizarre.

This is just another example of the reverse scientific method, where you start with a hypothesis and then desperately look for evidence supporting it - while you safely ignore anything you find which doesn't support it. And there is plenty of facts supporting the hypothesis that fibs dice are just ramdom.

Let me know when evidence was found that fibs dice are manipulated. Before that, there is no debate and I am on no "side" of it.
This space is available for rent by advertisers. Call 0900-INIMITE today, and see your sales skyrocketing in no time! New customers receive free Vl@9rå and a penis enlargement set as a bonus! We support banners, flash banners, and scrollers. Discrete handling by our HQ on the Dutch Antilles.

pck

#15
Quote from: inim on November 29, 2011, 01:02:46 AM
What two sides of what debate? So far not a single piece of evidence was presented that the dice are manipulated. What is presented is a lot of conspiracy theory how they MIGHT be manipulated and how that may be hidden by a malevolent admin. How bizarre, how bizarre.
No claim was made about having evidence for dice manipulation. Quite the contrary: In #11 I wrote: "[...] what clears FIBS of suspicions concerning fixed dice [...] is my luck."

Thoughts about how dice might be manipulated are not conspiracy theory but necessary steps in the process of clarifying what constitutes a proper test for manipulation. "Malevolent" or "diabolical" admins were never brought up until the blood started rushing to the heads.

The two sides of the debate are: Arguments in favour of dice manipulation and arguments against it. I believe that the arguments in favour of manipulation are weak. But I also believe that many of the arguments against it have been weak or confused as well.

Quote from: inim on November 29, 2011, 01:02:46 AM
This is just another example of the reverse scientific method, where you start with a hypothesis and then desperately look for evidence supporting it - while you safely ignore anything you find which doesn't support it. And there is plenty of facts supporting the hypothesis that fibs dice are just ramdom.
This is both logically and factually inconsistent. If you accept that there are facts in support of the hypothesis of randomness then you must accept all facts against it too. Whether these were gathered starting from a hypothesis of non-randomness or not is immaterial. The only thing that matters is whether they confirm the hypothesis or not. In matters of logic, there is no principle of "when in doubt, for the accused".

What are the facts in support of randomness? The results of the dicetest and matrix commands. These were not - as you claim - ignored, but put in their proper place: They do constitute evidence in favour of randomness and against manipulation. All I was concerned with was showing that that evidence is not as strong as one might think. To support this I constructed two very simple scenarios which can fool dicetest (more precisely, the first half of dicetest - see reply #7) and matrix (reply #13) respectively. In addition I presented XG stats, which show that my dice in 1100 FIBS matches were on the extreme end of the spectrum of randomness.

According to XG, the probability of getting even less random dice than I did in those 60000 rolls is 3.119%. That is not the same as winning the lottery, but enough to raise an eyebrow. To put it in your language: Which part of "worrisome" do you not understand?

Even if it were shown beyond doubt that FIBSdice are non-random, this would be no good reason yet to say that FIBS is rigged. As I already pointed out in #11, to successfully be able to conclude that, luck would have to be skewed as well.

Quote from: inim on November 29, 2011, 01:02:46 AM
Let me know when evidence was found that fibs dice are manipulated. Before that, there is no debate and I am on no "side" of it.
I never looked for evidence of manipulation and I never accused anyone of it. I looked at the data available to me and tried to make sense of how both sides of the debate were defending their positions. The logical and conceptual sloppiness inherent in "arguments" such as you present here is part of what prompted me to write about these issues in the first place. I believe that much of the dice manipulation debate is, if not plainly confused, talk at cross purposes.

On a personal note, while moonshadow's "burn in hell, heretic" approach was funny (yet effective, I got extra insurance for my house against hail and frogs after that), your persistently condescending tone is merely annoying and diminishes your credibility.

inim

Quote from: pck on November 29, 2011, 09:07:28 AM
Which part of "worrisome" do you not understand?

The part where we switch from verbose panicking to concrete scientific working. Where is the data, what was the method used in the experiment, and what prediction is made for the outcome of an indepenent repetition of the experiment.

A screenshot of a closed source program based on unknown data is not a reproduceable experiment and means nothing so far. In the past, the process of deriving the data was flawed (subsets were counted twice). So deriving the input data for the statistical analysis is part of the experiment and must be reproduceable as well.
This space is available for rent by advertisers. Call 0900-INIMITE today, and see your sales skyrocketing in no time! New customers receive free Vl@9rå and a penis enlargement set as a bonus! We support banners, flash banners, and scrollers. Discrete handling by our HQ on the Dutch Antilles.

garp_02

Can someone explain to me, without being nasty :), how the Fibs DG distributes the rolls?

I am no maths genius but am reasonably intelligent - so keep it simple.

It is my understanding that the DG's normally used in these situations are pseudo-random number generators which apply an algorithm to a particular seed number, which then produces a predictable sequence of rolls based on that seed. The same seed will always produce the same sequence. This is NOT random number generation, but, to all intents and purposes, will appear random enough for our purposes.

If this is correct then how are the seed numbers generated - as in the old 'who created the creator' argument. Not that I think this matters too much as it will still appear random, but not be random.

So if I startd a game with pck, say, does the DG start a new sequence of rolls based on a new seed which applies to our game only? Or is the number sequence running in the background and allocates the next roll in the sequence every time any player rolls the dice. In many ways, this would be more random in the true sense of the word.

Be nice with your replies

pck

Quote from: inim on November 29, 2011, 09:37:02 AM
The part where we switch from verbose panicking to concrete scientific working. Where is the data, what was the method used in the experiment, and what prediction is made for the outcome of an indepenent repetition of the experiment.
I've attached the data from which the analysis was generated. The method used is a chi squared test on the distribution of all possible rolls of two dice (as is obvious from the screenshot). There are numerous other evaluations such as race doubles etc. in the pdf I uploaded with the screenshots. Since this is a single "experiment" ("evaluation" would be a less misleading term) there can be no predictions.

Quote from: inim on November 29, 2011, 09:37:02 AM
A screenshot of a closed source program based on unknown data is not a reproduceable experiment and means nothing so far. In the past, the process of deriving the data was flawed (subsets were counted twice). So deriving the input data for the statistical analysis is part of the experiment and must be reproduceable as well.
This is confused on several levels but I can guess what you mean.

1) It's true that in gumpi's first attempt to have XG analyse my matches, the derivation of the results from the input data was flawed. Gumpi was new to XG then and did not operate it correctly when it came to telling the program that it needed to treat all of my opponents as a single player. Accordingly, the resulting statistics looked suspicious from the start: http://www.fibsboard.com/using-backgammon-software/extremegammon%27s-chi-squared-tests-on-fibs-dice/msg22180/#msg22180
He subsequently corrected this, but I never posted the proper results until you challenged me to in shouts.

2) As for the input data, these were of course never "derived", they are dice rolls from a little more than 1100 fibs matches. I assume that by "reproducing the experiment" you mean running the chi squared test again. "Deriving" or "Reproducing the input data" makes no sense.

The closed source argument will of course remain available as long as XG is used. I trust gumpi's ability to work XG correctly (esp. because he got it wrong the first time) and the author of XG to be capable of coding the correct formulas. But with the data I attached, you can run your own chi squared test. If you do, you need to make sure the number of degrees of freedom is the same as XG used (which is 21 - 1 = 20), otherwise the results will not be comparable, as Chi Squared depends on "binning".

pck

Quote from: garp_02 on November 29, 2011, 10:44:56 AM
So if I startd a game with pck, say, does the DG start a new sequence of rolls based on a new seed which applies to our game only? Or is the number sequence running in the background and allocates the next roll in the sequence every time any player rolls the dice. In many ways, this would be more random in the true sense of the word.
My guess would be the latter. I don't see any need to re-seed the DG every time a match is started, unless the algorithm is known to run into a not-so-random streak after a while, producing, for example, not enough 6s anymore.

I deliberately refrained from any speculation about how FIBS works internally, software or hardware. It doesn't change the core of the debate. What I want to look at are the statistics (rolls, luck, etc.) as the players get to see them, because that is what the criticisms are about.

garp_02

I, like others, don't see the reason why dice manipulation would be built into the 'program' even if this were possible. Who would decide who benefits from this manipulation and how would this practically be acheived?

The question of luck is on another thread but I would just say that luck is exactly that - luck. If the dice are predetermined, whatever the situation on the board, then the only thing that can affect this is the positioning of the pieces on the board. It doesn't matter how well you play, there will normally be one killer roll which will totally mess up your game. This can be limited, of course, by good strategic play, but not eliminated entirely.

The statistics about how the players see the rolls are dependant on the way those rolls are distributed. If each match is seeded individually, then the algorithm will only produce say a few hundred rolls for a 7 point match and will not have had time to balance out statistically.

On the other hand, if the predetermined sequence is spread across all matches, the resulting rolls we see may seem less random as you are only dipping into the sequence at certain points.

dorbel

I think you will find that Fibs gives a dice roll to the next player to ask for one, but that there is only one "list" of rolls for all the matches being played at any one time. It follows that any predictable sequence would be, by being shared among x matches, be impossible to spot.
Anybody can look back at x matches from their database, compile statistics from them and present the results as scientific evidence. It isn't. If you think "Hell, I've been really unlucky lately" and you look back at the stats, surprise, surprise, they show that you've been unlucky! That isn't evidence. Start sight unseen and examine your next thousand matches. If they show the same bias that would be evidence, but it's my guess that they will show something completely different. If you want to do that, I'll look at my next thousand too, as a control group.

Of course "bad luck" rather than, say, a very odd number of 6-6s is difficult to quantify other than using a bot which, as pck has already demonstrated, has a flawed and incomplete definition of the same. If there was some intervention that gave you "bad" rolls, it would have to be human, as when Marvin built Fibs, there was no bot working well enough to incorporate into the software, that could analyse a position in a fraction of a second and decide what a bad roll was! Even if there had been, why would he have done that anyway? Wouldn't it be incredibly hard to do? How would Fibs decide who got these "bad" rolls and who got the "good" ones? Are we really to think that Patti amuses herself presing a button that says, "Give pck bad rolls for the next two years?

With the greatest possible respect pck, because I like and admire you a lot, get a grip! It's a dice game.

Is it possible to have a very, very long run of "bad luck"? Neil Kazaross says that he once went two years without getting past the second round of a tournament! if it can happen to him, none of us are safe.


pck

Quote from: dorbel on November 29, 2011, 01:50:43 PM
[..]
Wouldn't it be incredibly hard to do? How would Fibs decide who got these "bad" rolls and who got the "good" ones? Are we really to think that Patti amuses herself presing a button that says, "Give pck bad rolls for the next two years?

With the greatest possible respect pck, because I like and admire you a lot, get a grip! It's a dice game.

I have said several times now that I never believed, nor do I now believe, nor do my XG stats prove, nor did I ever set out to prove, that FIBS is rigged. The idea was instead to get rid of a lot of useless arguments in the dice debate, on both sides.

With the same amount of respect, if anyone needs to get a grip, it is those who panick at the very thought that there could be such a thing as an imperfect random number generator.

One last time, in a nutshell, here is what I'm interested in:

(1) good serverwide stats (= non-skewed distributions of rolls) allow
    no inference as to the quality of single player stats. but it is
    single player stats which the complaints are about. hence
    serverwide stats are no counter to single player dice whining

(2) non-random dice are not the same as rigged dice. while rigged dice
    imply non-random dice, the converse is not true

(3) the issue of randomness is by far more complicated than it may
    appear. while it is correct to say that "the unpredictability of
    my next roll is what constitutes randomness", actual proof of said
    unpredictability is a conceptually and technically complex
    problem, which involves more than counting how many 6s you roll on
    average (dicetest) or how many 6s you roll on average after any
    other roll (matrix)

(4) in order to reject accusations of rigged matches, a better
    criterion than dice stats are luck stats

dorbel

Nobody on fibs can predict the next roll with a greater accuracy than the theoretical probability. That's good enough to play bg with and other discussion of concepts of randomness would be better off in a mathematical or philosophical forum perhaps.
Do we really need to debate this? It's rather like UFO belief, or "Intelligent design" or Flat earthers. We don't have to disprove piece by piece their "evidence". I agree that the fact that every apple falling from a tree has so far been observed to fall downwards, is not evidence that the next one won't ascend, but we don't need to give the thought equal weight with our experience. We can't disprove dice manipulation, because it is possible, but it seems more likely to me that those who think it has ever happened on Fibs are delusional.
Let 'em roll!

moonshadow

Quote from: pck on November 28, 2011, 10:40:21 AM
Most of what I need to reply here has already been said by diane and Slip.

No, they completely missed it too. They assumed you said something you didn't.

Quote from: diane on November 28, 2011, 02:12:47 AM
I actually don't think for one moment that pck thinks there is any bias, or that anything untoward going on with regard to dice at fibs.

Quote from: Slipshod on November 28, 2011, 02:25:03 AM
Pck is not suggesting Marvin intentionally programmed the dice in a manner that could introduce bias.

That is precisely what pck suggested.

In response to my post on Turner's analysis of 10,593,121 rolls of FIBS dice, pck states

Quote from: pck on November 21, 2011, 10:16:32 AM
Pointing to serverwide statistics isn't as strong an argument against allegations of manipulation as it may seem.

The definition of "manipulate"  (New Oxford English Dictionary)

Quotecontrol or influence (a person or situation) cleverly, unfairly, or unscrupulously: the masses were deceived and manipulated by a tiny group.
• alter (data) or present (statistics) so as to mislead.

There is no other manner in which the word "manipulation" can be construed in this sentence to mean anything other than the creator of FIBS code, which in this case is Marvin, intentionally programmed the dice in a manner that would introduce bias.

pck  then immediately gives his counter example where the astute reader will note he ambiguously states "FIBS is programmed," which in the context of the above "allegations of manipulation" sentence can only mean that it was Marvin who unscrupulously and knowingly programmed FIBS in such a manner that the dice rolls appear to be non-random sequences, but in fact are not:

Quote from: pck on November 21, 2011, 10:16:32 AM
Imagine the following scenario: Unbiased dice generator (DG), exactly two players are logged into fibs. Fibs is programmed to behave in the following way: If on player 1's turn the DG rolls a 66, the roll is put on hold and instead the player is given the next roll produced by the DG (if that happens to be a 66 as well, the process is iterated until one of the other 35 rolls comes up). The 66(s) is(are) given to player 2 on her next turn(s). Result: Non-random dice sequences for both players, while any serverwide stats like dicetest will detect no bias, no matter how large the the number of rolls.

Though pck later in the thread more or less rules out he does not think Marvin intentionally programmed bias into the software, that is not what he initially said. I merely replied to what was said and ran with it, albeit in colorful fashion, or as pck later aptly put it, a "burn in hell heretic" approach. (Pck is fortunate I did not try the "moon you" approach as thats been known to cause post traumatic stress syndrome.)

Initially, I had thought the Turner Analysis of FIBS dice rolls to be significant if for no other reason than it was a large sample of 10,593,121, that it had been done by a professional statistician, that it did show that for 10,593,121 rolls of Fibs dice the rolls fell within the expected percentages of distribution, and that professional statistician Turner, despite lots of technical babble and waffling around about terminology in the analysis, concluded in language I can understand that the "dice appear to be fair."

And though I must disagree with pck on my bp exceeding that of vic's in my followup post, I must confess that my Turner Analysis is very much like Vic's magnificent Christmas Goose of 2010 and when I saw Turner's Analysis , which I had painstakingly dug out of the archives and lovingly presented to the masses being desecrated, maligned and ignored by pck, my ego suffered irreparable damage and I had to express my pain.

The discussion in the thread has certainly livened up and if nothing else pck has expanded on and developed some of his thoughts on "randomess" which I've found interesting--and for someone who doesn't like nor understand math as much as I do, that's a compliment. And I understand that pcks motivation, as he puts it is "to show that both sides of the dice manipulation debate have there weaknesses." (And here again is an unintended use of the word "manipulation" to mean something else.)

In reading through the thread I see references to "dice manipulation," "dice manipulation debate" and that the word "manipulation" is often carelessly being used (see definition earlier in post) and should be avoided unless one thinks that "someone" is intentionally trying to deceive by writing "rigged dice" code.

I suggest the word "skew" or "skewed" is an accurate word as to what is being discussed, as in "skewed dice debate" or "skewed dice". The NOED defines skew as:

• [ with object ] make biased or distorted in a way that is regarded as inaccurate, unfair, or misleading: the curriculum is skewed toward the practical subjects.

Skew is neutral in that there is no implied evil or nefarious intent. "Skewed dice" therefore would include dice that for one reason or another are biased.

Entertaining and informative thread.

pck

#25
Quote from: dorbel on November 29, 2011, 04:24:21 PM
[...] We can't disprove dice manipulation [...]
My luck coming out as nearly zero in my XG stats is actually pretty good proof that there is no dice manipulation.

Quote from: dorbel on November 29, 2011, 04:24:21 PM
[...] That's good enough to play bg with and other discussion of concepts of randomness would be better off in a mathematical or philosophical forum perhaps. Do we really need to debate this? [...]
Why not? Nobody has been forced to join this thread. I'm not motivated by a desire to prove or disprove that FIBS is rigged. It is rather that thinking about what constitutes actual arguments for or against randomness and rigging is a pretty good opportunity to improve one's understanding of these concepts. There may not be much idealism left in me, but I'm still - perhaps naively - clinging to the thought that with better education the need for conflict will decrease.

On your bg blog you do not simply tell your readers what moves they should make, but also why they should make them. From this and our chats I'm positive that you are not entirely unsympathetic to the idea of conceptual clarity.

If a player X tells me that the bot rolled 66 55 66 in a race that X would have won otherwise, I consider replying that "Andreas and Patti are the nicest people, why would they do this to you on purpose", or using the confused Pavlov-reflex of "all dice sequences have the same probability", as inferior to explaining that to even get to that favourable position from which the bot came back, X had to have had a lot of luck as well, perhaps accumulated in smaller doses, and thus gone unnoticed, over many rolls. Understanding how luck works will automatically put accusations of manipulation to rest. Invoking authority or unintelligible pseudo-mathematical arguments will not.

I believe this example shows that this isn't purely about mathematical or philosophical interests. And even if it were, or sometimes actually is, I don't see why thinking about it should be relegated to some broom closet. I think it's more fun not to aim low.

pck

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
No, they completely missed it too. They assumed you said something you didn't.
They assumed I had different motives for my post than you did. The difference is that they were right. In addition, Slip nailed the general message behind the example scenario I gave, which was about good serverwide stats not being conclusive evidence against allegations of non-randomness or rigging.

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
There is no other manner in which the word "manipulation" can be construed in this sentence to mean anything other than the creator of FIBS code, which in this case is Marvin, intentionally programmed the dice in a manner that would introduce bias.
And that is exactly how I meant it. However...

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
pck  then immediately gives his counter example where the astute reader will note he ambiguously states "FIBS is programmed," which in the context of the above "allegations of manipulation" sentence can only mean that it was Marvin who unscrupulously and knowingly programmed FIBS in such a manner that the dice rolls appear to be non-random sequences, but in fact are not:
You'll note I preceded the entire paragraph with "Imagine the following scenario: ". "Imagine" as in "hypothetical". As in "not necessarily true". And with regard to the underscored bit above, as in "change of context". I didn't want to have to use the conditional throughout the whole explanation. So the entire thing translates to "If FIBS were programmed in the manner described, dicetest would find no fault with the players' rolls, even though the dice are clearly non-random for both".

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
Initially, I had thought the Turner Analysis of FIBS dice rolls to be significant if for no other reason than it was a large sample of 10,593,121, that it had been done by a professional statistician, that it did show that for 10,593,121 rolls of Fibs dice the rolls fell within the expected percentages of distribution, and that professional statistician Turner, despite lots of technical babble and waffling around about terminology in the analysis, concluded in language I can understand that the "dice appear to be fair."
I think of Turner as nothing less than a superhero of backgammon. If there were an action figure of him available, I'd buy five and would never open the boxes.

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
And I understand that pcks motivation, as he puts it is "to show that both sides of the dice manipulation debate have there weaknesses." (And here again is an unintended use of the word "manipulation" to mean something else.)
It's true I have used "manipulated" both in the sense of "rigged" (= making people win or lose by dice manipulation) and "non-random". Bit sloppy, but I don't think it caused any major damage. "Skewed", as you point out, would have been more accurate in places.

Quote from: moonshadow on November 29, 2011, 05:59:14 PM
Entertaining and informative thread.
Beats even some episodes of The Simpsons.

pck

Quote from: dorbel on November 29, 2011, 01:50:43 PM
Of course "bad luck" rather than, say, a very odd number of 6-6s is difficult to quantify other than using a bot which, as pck has already demonstrated, has a flawed and incomplete definition of the same.
I'm not aware that I demonstrated that the bots' definition of luck is flawed and incomplete. I don't even believe that. I think that the definition of luck the bots use is perfectly fine and is actually the only one which is available (difference between pre-roll equity and post-roll/best move equity). The actual numbers they calculate are flawed because the bots' estimations of a player's winning chances are just that - estimations. That is why in gnubg, after a match (luck_player1 - luck_player2) + (skill_player1 - skill_player2) is almost never exactly 50%, as it should be.

There is a kind of luck which is not captured by the bots' definition. If I have only easy decisions in a match, I'm going to make the best move more often and will thus have better chances of winning. But this kind of luck is not quantifiable and does not come from the dice alone.

lewscannon

OK, but none of this explains why the bots cheat with their better dice.

Love and kisses,

lews, on behalf of The Panicked Rabble

pck

Quote from: lewscannon on November 30, 2011, 04:42:12 AM
OK, but none of this explains why the bots cheat with their better dice.

You tell bonehead:  why are you cheating with rigged dice?
bonehead tells you:  all normal people are cheating with rigged dice
You tell bonehead:  but why you especially?
bonehead tells you:  hmm, dunno
You tell bonehead:  is it because you hate humans?
bonehead tells you:  you could be right
You tell bonehead:  you know we could pull the plug on you anytime
bonehead tells you:  I can fish!

PersianLord

I think a major player which stirs this ridiculous conspiracy about FIBS dice is based on a misunderstanding of the theory of probability.

We don't seem to be able to distinguish between 'dependent events' and 'independent events'. When my opponent rolls 4 consecutive doubles which put him/her on the edge of winning, I begin to think that 'since s/he have rolled 4 doubles in a row, there is less probability to roll another in the coming rolls'. So I build a baseless expectation in myself, and sometimes I even invest some 'hope' in this miscalculation. But since dice events are independent, there is absolutely no reason why my opponent can not roll another 4 doubles and when he does, a kind of rage overwhelms me and I think I was cheated by a rigged dice in a rigged server. Reactions vary, from sudden, violent and often rude curses at dice in kibitz and shouts (if you're no server-gagged I mean) to  opening threads in FB or elsewhere.

Another problem is that we often overlook our own constructive, not lucky, rolls and just concentrate on matches when we got nonconstructive , not unlucky, rolls. Does this have something to do with ego? I think yes.

Well, these are both wrong, but I have to add that these problems arise because the operating systems of our minds have a built-in tendency to think that events are connected and dependent to each other, because it IS so in the real world. ALL IS ONE and no deed of any human goes unchecked in the universe, for universe is like a mirror reflecting our emissions instantly. If I cut a tree in my backyard, it's impact doesn't confine to just my backyard. It affects the whole universe. So, in the real world, every single event is connected and in an inter-dependency mode with other events and this might explain why our minds have been aligned accordingly to think so. But hey, FIBS is a mind construct, not a real thing. An illusion within an illusion. And thus, has it's own rules.

The leftist's feelings of inferiority run so deep that he cannot tolerate any classification of some things as successful or superior and other things as failed or inferior. This also underlies the rejection by many leftists of the concept of mental illness and of the utility of IQ tests.  - T.K

pck

Quote from: PersianLord on December 03, 2011, 06:29:08 AM
I think a major player which stirs this ridiculous conspiracy about FIBS dice is based on a misunderstanding of the theory of probability.
This was never about conspiracy. Read replies #11, #13, #15 and #22 of this thread. Misunderstandings about the concepts of randomness and probability abound, and clearing them up isn't easy, especially against predjudices and confusions which many of the participants of this debate have endorsed for years.

Quote from: PersianLord on December 03, 2011, 06:29:08 AM
[...]But since dice events are independent, there is absolutely no reason why my opponent can not roll another 4 doubles[...]
Quite correct, but with regard to the issue of randomness, the proper question is not to ask "can it happen?". Of course it can. Rolling 20 doubles in a row is not impossible. But the real question is, and it takes no genius to see that, "how often can we expect it to happen?". Unfortunately, the answer to that is conceptually and mathematically complex. The chance of rolling 3 doubles as my next three rolls is (1/6)^3. But that is not usually the situation we face in a bg match. In a match, if someone, at some point, rolls 3 doubles, it is confused to say that "a 1 in 216 chance was just realized". It is these subtle but crucial distinctions which make the fair dice debate so hard.

Quote from: PersianLord on December 03, 2011, 06:29:08 AM
Another problem is that we often overlook our own constructive, not lucky, rolls and just concentrate on matches when we got nonconstructive , not unlucky, rolls.
See #25, previous to last paragraph.


garp_02


diane

Never give up on the things that make you smile

PersianLord

The leftist's feelings of inferiority run so deep that he cannot tolerate any classification of some things as successful or superior and other things as failed or inferior. This also underlies the rejection by many leftists of the concept of mental illness and of the utility of IQ tests.  - T.K