Answer: 0.0126; 1.26% or about 1 out of 79.
I made a Excel spread sheet to solve this witch I added as an attachment.
Basically you were on the right track in your post
Obsidantion, you noted that there is only a few types of outcomes of the first roll. You can divide it into 5 different categories:
- All 5 dice show the same number
- 4 dice show the same number
- 3 dice show the same number
- 2 dice show the same number
- and finally no dice show the same number
So we need to know how many out of 7776 possible outcomes goes in each category. This is what I came up with:
None: 720 Pairs: 5400 Trips: 1500 Quads: 150 All: 6
Here I have just counted all the occurrences from a list of all possible outcomes. Of course it is possible to calculate this one at a time, but the math is a bit complicated...
I will give one example:
//
For three of a kind or Trips as I have called them there is basically 6 different kind of result that interest us: 111; 222; 333; 444; 555 and 666.
Looking on one of them, 555 it can occur in lots of different ways, 5X55X; XX555; and 5X5X5 to name a few. Here the X is the dice showing anything other then 5. The number we are seeking here is the number of combinations to pick 3 out of 5 dice in no specific order, the number is 10.
The dice showing anything but 5 has each 5 different possible values. A total of 25.
So the total number of Trips is:
6*10*25 = 1,500
//
When calculating the number of Pairs, make sure to exclude any Pair where the other dice is a Trips! The number of combinations that does not have a pair or better is calculated by how much is left when summing up the other categories.
The chance to complete the five of a kind is calculated for each case as:
(1/6)^n where n is the number of dice rolled.
So to complete the calculations the probability for each case is multiplied by the chance to complete the five of a kind and the results are summed up!