|
Today's Hearing on Oracle's 3rd Proposed Damages Reports- Eyewitness Report ~pj Updated 4Xs |
|
Wednesday, March 07 2012 @ 07:04 PM EST
|
We did have a volunteer [update: two] present at the hearing on Google's motion to snip off and discard chunks of Oracle's 3rd attempt at an acceptable damages report in the Oracle v. Google case. This is about what, if anything, the jury gets to hear from Oracle's expert as to his opinion of how damages should be calculated, if Oracle should prevail, which frankly is looking less and less certain. A huge thank you to Steve Finney for making such an effort to be there. Oracle's expert, Dr. Ian Cockburn, was in attendance, as ordered by Judge William H. Alsup, but he didn't get asked anything. The judge had asked the parties to be ready to answer some very specific questions [PDF], and he did ask both sides plenty of questions.
Jump To Comments
Here are the questions the judge said he wanted answered:
For the hearing on Wednesday, the Court would like to learn the
following. How did Dr. Ian Cockburn choose which studies to rely on for
the patent-value curves? Do studies not chosen, such as those listed in
Harhoff et al., have less skewed curves? Please bring copies of
all references and studies with patent-value curves, not just the three
selected by Dr. Cockburn. Based on the three studies cited, what is the
confidence interval for the proposition that the top 0.5% of patents are
worth 32.7% of the value (also, that the top 4% of patents are worth
10.2%)? What would be the value of the ’104, ’205, and ’720 patents if
they ranked as the bottom three of the “top” 22 patents? For all
statistical analysis, including the conjoint analysis, the Court is
interested in the confidence intervals of the results. Under the group
and value approach, what is the separate value of each patent in suit?
Both sides shall exchange whatever illustrative materials they plan to
use by 5:00 P.M. ON TUESDAY. Please come prepared to hand up
precise evidence to back up assertions. That gives you a hint as to what the judge thought wasn't so great about earlier attempts at damages reports, I think. He wants specificities.
Steve has sent his first half of his notes and will now take a moment to breathe and eat something and then he'll work on the next half. It's not, of course, a verbatim account, but we'll get that in 90 days in the transcript. This is to provide on the overall picture and provide the highlights. He has put his comments about the proceedings in brackets.
The first report takes us up to the break in the proceedings today in Judge Alsup's courtroom in US District Court for the Northern District of California in San Francisco:
Hi PJ and Mark: Here is my description of the 1st half
of the morning hearing. None (except for one marked quote)
is verbatim; much is close paraphrase, but in some places
I summarized discussion in what is more of a loose paraphrase
(which doesn't put arguments in anyone's mouth, but may disrupt
the flavor).
However, since it does appear as if I'm putting words in
people's mouths, perhaps this should best be viewed as
a dramatic reenactment involving 3 characters, TC (The Court),
Oracle, and Google, which bears some resemblance to (but is not
identical with) this morning's proceedings.
My comments about the proceedings are in brackets "[]".
****************
The hearing started promptly at 7:30 AM. I didn't get all the lawyers'
names. For Oracle, Michael Jacobs of Morrison & Foerster was present, and I believe Steve Holtzman of Boies Schiller, but
it seems as if someone named "Norton" did the bulk of the talking.
(He had a reddish beard and mustache, and light-rimmed
glasses; no other Oracle lawyers had facial hair).
For Google, Robert Van Nest was present, but I believe a Mr. Purcell did
the bulk of the talking.
[Courtroom 8, SF Federal Building]
[7:30 AM]
Judge Alsup: I want to start with a big picture question. When we talk
about the 2006 100 million dollar offer, was that per year, or a one-time
payment?
Oracle: This was to be paid over a 3-year period, but this was still
under negotiation. It was not a full payment and would be
renegotiated after 3 years.
Judge: This is an important question. Was this a one-time paid license,
or would more money be paid over time? This affects the issue of
damage calculation on a royalty basis. What did the 100 million pay for?
Google (Van Nest, this time): I'm not sure. This was something
that should have been covered in the Cockburn and Leonard reports.
I believe it was a one-time payment that covered everything.
[Judge Alsup seemed concerned that the point isn't known for sure.]
Judge: Next question: Are current 2012 damages numbers the same as in earlier
reports?
Oracle: Not identical, but compatible. It depends on whether you look at
independent signficance analysis or group and values analysis. [Oracle
refers to provided charts.] The '476 patent has been dropped
so that changes things a little.
Judge: Question 3: Could you check my math on the 10% line item?
I came up with $32 million for patents, but Oracle's number was
different (44.8 million for all 5 patents).
Oracle: [Discussion I couldn't follow referencing slides, various curves
and equations.
Somehow the discussion transitioned into the issue of patent value
curves. In the patent curve discussion,
I'm summarizing things Judge Alsup and Oracle said over the course of 5 or 10
minutes of discussion. It's not necessarily in order, but the
content should be accurate.]
Judge: Here is a fundamental question. Oracle cites 3 studies
about patent value. If you look at the top 20% of the 3
different curves, they're quite similar, and I'm willing to
accept that. It matches the standard 80/20 rule.
Even the 10% numbers are at least similar.
But when you go below that, it diverges a lot.
When you look at just the top 1%, the numbers for the
3 studies are quite different (42%-78.4%). And three studies
is a very small number. Can you
say, with any statistical confidence, that a fourth
study would even fall within that range? We are not
just looking at the tail of the distribution; we're looking
at the tip of that tail. Don't we need more samples?
What kind of confidence interval?
Oracle: [provides a list of about 5 studies, omitting
Barney (it was not a "survey" study), but a few more than originally].
We only looked at studies that surveyed patent value that also
provided sufficient data to do a patent distribution curve.
The Cockburn report cited multiple studies in support of the
concept of skew, but only the PatVal report was used
for Cockburn's quantitative analysis.
Even five studies are not sufficient to calculate a confidence interval.
Putnam [some case reference] is an example where a single
curve was used to calculate damages, and it was accepted.
Judge: Was that a Federal case?
Oracle: No. [PJ: We think after putting all our heads together that it was a Federal case, but not a *jury* trial, rather one with only a judge making the decision based on the law only.]
Judge: So, just a bench judge. Did the judge address the issue
of the tip of the tail?
Oracle: No.
Judge: OK, it sure looks like Cockburn used three studies [cites paragraphs
in Cockburn report], but you're saying that only the PatVal study was
used for numbers. So that's only one data point.
Oracle: It was the best study -- 23,000 data points. If there's a gold-standard
study [makes a hypothetical reference to a hypothetical well-funded NIH cancer
study], that's all you need.
Judge: Where in the Cockburn report is the defense of the Patval study?
Oracle: It's not in the report. It's in the depositions.
Judge: But by Rule 26, all the relevant information has to be in
the report itself [Something about the depositions not being
court-admissable evidence].
Oracle: It would be an insurmountable obstacle to comprehensively
defend the methodology in the report itself.
Judge: It is critical that the statistics of the patent value
calculation be correct.
"You're not convincing me". [That's a direct quote.]
Oracle: Cites Lucent. Some vagueness is acceptable. Cites Dainhu Tire (sp?)
case: "reasonable approximation" is acceptable.
These issues relate to weight, not methodology, so a jury
question, not Daubert. Providing a range of results is not
necessarily methodologically
unsound. Cites a case about nuclear radiation exposure.
[8:20 AM]
Judge: Google, what is your response?
Google: [Much of what Google said here duplicates what's in the briefs,
I may have not noted all of it.]
PatVal applies to a random patent selection, not to this
narrowly focussed patent selection.
Judge: So what is so special about Sun?
Google: It's not a question of "Sun's portfolio". It's the fact that the
patents were explicitly selected from Sun's total portfolio (about
14,000 patents in 2006) to be of *particular* value. The chaff
has been removed.
Judge: Would that make the 500 patents more or less valuable?
Google: The 597 patents are presumably the most valuable. Any calculation
involving 100% of the deal value should be more evenly distributed
across the 597 patents.
Cites Schenkerman [sp?] study, which addressed specific technology
areas. There is still an obvious skew, but it's less than the studies
Cockburn cites. Top 1% had 24% of value; top 5% had 55% of value.
Oracle: The patent selection was done looking for patents relevant
to Java smartphones. It was patent selection done for a technology
area, not for value.
The Schenkerman study showed that electronics had a higher
[something: skew?] than other industries. If the PatVal study had
been restricted to electronics, it might be even more skewed towards the
high end.
Schenkerman was based on patent renewals. This will tend to
flatten the curve, and artificially reduce skew.
[8:37]
[Topic changes to issues about Oracle's use of in-house engineers to
do patent ratings. After a short exchange between Google and Judge Alsup, Judge Alsup
basically states that this is a cross-examination issue, not a
Daubert issue].
Google: Our next point is the indeterminacy of the Cockburn
report. In the independent significance analysis, Cockburn
uses a vague methodology and uses the phrase "at least", which
doesn't provide a limit.
Judge Alsup: Is "at least" used in the Cockburn report?
Google: No, it's in the depositions.
Judge: Only the original report can be used at trial. However,
there are no limits at cross-examination. It is Google that
will be at risk if they introduce issues relating to "at least"
during cross examination.
[Google moves on to groups and value.]
Google: The Oracle engineers chose the top 22 patents, but
rated those patents as of approximately equal value (they
could not distinguish them). This gives a lower bound of 17.7 million
if the 22 patents are rated equally, but 51 million if the
claim is that these 3 patents are the 3 most important
patents. The Oracle engineer data does not support the
upper bound.
Judge: Where is the reference about engineers' inability to rate the
top 22?
[Google can't find it; the judge says they were supposed to be prepared.]
Oracle: We concede [possibly didn't use that exact word] that
the engineers couldn't distinguish technical
significance among the 22 patents in 2006, given the Google
product requirements
[this is presumably whatever Android product requirements document that
was provided to the Oracle engineers in 2006].
However, Dr. Cockburn is an economist, and it's possible to distinguish
among the 22 patents based on economics/financial stuff.
Judge: In 2006, was there any reason to believe that these
3 patents (presumably '105, '204, and '720] were the most important?
[Here and above, there was some discussion that I really couldn't follow.
Issues related to what happened in 2006 and what's happening
now, when the infringment occur, hypothetical 2006 negotiations,
post-2006 development of Android, patents vs specific technology,
and the fact that the '720 patent wasn't issued till 2008 (!?)].
[9:11 AM: break (court reporter needed one)]
It's obviously not good when a judge tells you you aren't convincing him.
Some background for anyone new:
Google objections to the report,
here and here, and on who contributed to the third report
here.
Oracle's side is here, and
Cockburn's declaration in support is here.
Two engineers swear on the Bible that Oracle is right
here and
here.
And if you are curious about the earlier reports that the judge wouldn't accept:
Dr. Cockburn's 2d report, not allowed in is
here.
The parties answer the judge's questions about the report:
here.
Google's objections and the judge's to that report are
here.
Oracle's viewpoint is here.
The last hearing transcript about damages is
here.
Fighting over the first report, which also was not accepted by the judge,
here,
here, and
here.
It all began with a motion by Google, a type of motion called a motion
in limine, which is just the name for the kind that asks that
something in a report, or testimony by someone, not be
allowed at trial. So the issue is what does the jury get to hear?
Does all this make you want to be a lawyer? Probably not. Now you know why they are the second most sleep-deprived category for types of work, or so I read the other day. All the above is done on deadline, and then the judge throws some extra questions at them a day or so before the hearing and says, be ready.
Swing back by in a couple of hours, and we'll finish the report. We had a second volunteer tell us he'd try to attend as well, and we may hear from him by then also. Mark will also try to stop by and provide any explanations he thinks would help us understand some of the finer points also.
Update: I just heard from our second eyewitness, Groklaw member mirrorslap, and here is his first report, with the second coming after he types up the rest of his notes:
Oracle v. Google
Hearing on 3rd damages report
March 7, 2011
U.S. District Court
450 Golden Gate
San Francisco
I arrived at the court at 7:35AM and the proceedings had already started,
so I missed the introductions.
Mr. Van Nest was up for Google, against (I believe) Mr. Jacobs for Oracle.
Judge Alsup (JA) presiding.
My asides are in brackets: []
This is my first time trying to follow the proceedings, and my appreciation for the skills of court reporters has increased. I was able to grab some of the more pointed and interesting interactions but this is nowhere near a transcript of what happened. I have 20 pages of notes that I am transcribing.
They were discussing the Sun-Google negotiations and the terms of the proposed contract.
Judge: “Wouldn't that have been smart?”
Oracle: It would have been a 3-year, paid-up license.
Judge: [appears to be getting vexed with Oracle] “I hear you saying the sky is dark; then you say the sky is light.”
$100M is a 3-year term?
Oracle: It was a 3-year term for $100M. Google's infringement is greater than $100M.
Judge: So you pick $100M as a starting point and adjust for all the variables. Has this been adequately briefed?
Oracle: Not [at?] all.
Judge: Dr. Cockburn (pronounced co-burn) has dropped 2012 from the current damages report (in order to be able to ask for damages for 2012 separately). Are the new numbers after dropping 2012 the same, lower, or higher?
Oracle: Mostly the same. The lower bound is lower, the upper is higher.
[produces a large binder for the judge; there are no visual aids for the gallery so we cannot see any of this.]
Tab 1 of the binder shows the steps that Dr. Cockburn used to prepare the damages for the patent and copyright infringement.
Upper bound, patent infringements: $46.7M
Lower bound, patent infringements: $17.7M
(excluding of the '476 patent, which has been dropped)
$57.1M damages upper bound
$43.7M damages lower bound
Judge: This will do... very helpful.
Oracle: Tab 2 not related to copyright, similar to “independent significance” approach.
Judge: Yesterday I sent out a request for a check on my math in calculating the 10% line on item 34.
Oracle: Items 6 and 7 address this; we did have to make adjustments for the Court's math [very diplomatically put], but there is some question regarding whether the Court used an average of the 3 curves or simply chose the middle one. The total should add up to $597M [not beeellions].
So the value for the patents-in-suit ...
Judge: A range of $32M to $44M for 5 patents, assuming equal value. $44M is the total for all 5?
Oracle: Under those assumptions, yes. The problem we [Oracle] have is that the curve is not linear; by treating the top 4% as if they are in the top 22%, it significantly reduces their value. This is the primary problem with the approach.
Judge: You have 3 sample [patent] portfolios. No one doubts that these curves have a disproportionate value at the ends. But Dr. Cockburn is trying to derive huge amounts based on 3 data points. When you get down to 1% [of the most valuable patents], the numbers aren't even close, and some statisticians would treat them as outliers. But Dr. Cockburn is using them as a basis. Looking at the wide variation in the curves at the top of their range. We are not talking about the top 20% [where the curves apparently are somewhat in agreement], we are looking at the top 1% [of some 576 patents]. Don't we need more data [to have a statistically significant result]? Aren't we looking at the tail, or the tiny tip of the tail? I see absolutely zero analysis of this from Dr. Cockburn.
Oracle: [Provides another set of documents (smaller) to the Court about this (as a part of the Court-ordered documents for this hearing). Again, the folks in the gallery cannot see the documents.]
The documents referred to all patent curves.
Dr. Cockburn relies upon the “patent val survey” method.
Similarly, this method was used by Dr. Putnam in the LG Display case.
Judge: Was that in a District Court?
Oracle: Yes.
Judge: Well, that's just some District Court judge talking [some self-deprecating humor?]
Did that judge address the “tip of the tail” issue?
Oracle: That issue was not addressed.
Please look at item 5 in the small handout. The Court states that a 4th sample [portfolio] could be wildly different. Dr. Cockburn is here and is available for questions. The 3 curves intersect at various points. Looking at the available curves, they look similar. Now the “confidence interval” question...
Judge: [Interrupts] Where is Barney on here?
Oracle: Barney isn't on this document.
Judge: You have chosen curves that support your case. You have conveniently left Barney out.
Oracle: Barney is not a survey.
Judge: It looks like he (Dr. Cockburn) used it until it was inconvenient for him and then he dropped it like a hot potato.
Oracle: Starts explaining why the “patent-val” method is the best survey method; strongly disagrees about the Barney being applicable here.
Judge: I don't know what you've been reading, but it says right here in paragraph 405 that he (Dr. Cockburn) used Barney.
Oracle: Patent curves are skewed. Patent-val best predicts the values.
Judge: Ref. P. 406: In each of these studies, ref exhibit 34, this is where he (Dr. Cockburn) gets 42%?
Oracle: Perhaps I am not being clear. Dr. Cockburn uses Barney as a demonstration of patent curve skew.
Judge: That's one study, and you rely on it to predict portfolio value based on the tip of the tail. Where is his (Dr. Cockburn's) analysis in the report? Any portfolio's top 0.5% to 1% will conform to these curves -- that is what you are saying?
[Exchange missed. The fur is flying. Judge Alsop appears to be sorely vexed.]
Oracle: It would be an insurmountable barrier for experts to explain every basis.
Judge: At least the top 20% of the portolio will comprise disproportionate value, let's concede that. But once we get to the top 10%, they diverge wildly. In my mind, this cries out for more samples. You are basing this on 3 portfolios. What is the purpose of a Daubert report? Where did you find that in the literature?
Oracle: We do not assert, nor do we need to assert that the tip of the tail be identical. They are in a tight range.
Judge: I can't believe that you thought I'd be dumb enough not to notice that you'd left out Barney. [verbatim]
Oracle: We are prepared and have addressed that. The analysis suggests a range of results. There is a reasonable approximation of a range of results, from X to 3X [!!!].
Case law: in the District of Colorado, Cook v. Rockwell. Exposure to plutonium and the effect of radiation dosage. The court said that within the meaning of rule 702, it is possible to make a reasonable approximation. The jury can decide which curve is a better fit.
Judge: It's like you are trying to bring in another report. I want to see the other reports. Shouldn't we just toss this one (Dr. Cockburn's) out?
Oracle: Cites example of one of the studies where the patent-val study is cited as the “gold standard” study methodology.
Judge: Are there flaws [in the execution of] this [particular] study? Is it not problematic to be drawing conclusions from a single survey?
[Now the judge turns to Google.]
Judge: What's your answer to Tab 4?
Google: These studies are a bad fit for these portfolios. Perhaps if Oracle had looked at the entire 14,000 patents in Sun's portfolio, but Oracle winnowed them down. Refers to Shankerman study (in the larger binder).
Judge: [holds up a chart] I don't think that you are coming to grips with Oracle counsel's point. Their top range is from 42% to 52%.
Google: They are looking at the wrong portfolio.
Judge: If we looked at the 14,000 patent portfolio, but we aren't, we are looking at 597 patents [actually 569]. Would they be more valuable or less valuable?
Google: They [Oracle] have gotten rid of all the chaff and have selected the most valuable patents. The 569 patents in the narrow portfolio are already in the top 10% [of value] in the 14,000 patent portfolio.
[… more later...]
Update 2: And here's Steve's part 2:
[Court reconvened after break]
[9:29 AM]
Judge: Google, what's your next objection?
Google: There's a lot of things that are adequately covered
in the brief, so I'd like to make 4 points about the conjoint
survey issue.
One, it's not an accepted tool for damages.
Judge: But surveys certainly have been used to calculate
damages before.
Google: But not conjoint surveys. There, you're going from features
to market share to a damages number. It's not mathematically
precise.
Two, in Shugan's methodology you have to hold the other
features constant. The data showing that 24% of the respondents
preferred or were indifferent to the same phone for $200 vs
$100 indicates a fundamental problem with the methodology.
Three, the focus group identified 39 important smartphone
features, but Shugan only/arbitrarily chose 7 of these factors for
his conjoint analysis, focusing only on certain issues important
to Oracle. Omitted factors include important factors as network
provider and brand.
Judge: Availability of WiFi was also not included, correct?
Google: Yes. And you can't simply do the survey with the
supposedly infringing features; that will inflate the value
of the patents.
[The next portion follows my rough notes, and there was some
rehashing of the briefs].
Judge: [Tries to create a simple example with car and radio vs
car without radio (and cheaper). Discussion about whether all
features need to be included]
[9:40 AM]
Judge: Why doesn't the "assuming all else constant" take care of that
objection? Why do you have to question it?
Google: Shugan did not ask in his focus group what were the
most important factors; he has no data on that. And you need
to know that.
Judge: It makes sense that they'd only test litigated features.
[Judge seems to be dubious of Google's arguments here.]
The conjoint analysis bears on two somewhat separate issues:
a) The 24% of the survey population that appeared indifferent to
a price increase.
b) Consumer feature choice/preference.
Could Oracle simply remove the problematic 24%?
[I lost track of Google's Point #4. Apparently Shugan had said confidence
intervals could not be calculated for this sort of conjoint
analysis. Google's Leonard claimed it could. Supposedly Oracle
has now supplied confidence intervals].
[9:46 AM]
[Oracle responds to Google's points on conjoint analysis.]
Oracle: Google's own expert, Alan Cox, repeatedly cites choice modelling
(which is the same thing as conjoint analysis) as a basis for
calculating damages.
Even if such an analysis hasn't been used before a court before,
Lucent tells us it is appropriate.
Judge: Which of the 7 features in the conjoint analysis survey
relate to copyrights rather than patents?
Oracle: Availability of applications, which depends upon the copyrighted
APIs. It was of value to Google for application developers to use the
APIs they were familiar with. Although the Java language is free to
use, the API's are copyrighted.
Judge: How did the application availability feature rate among the 7
features tested in the conjoint survey?
Oracle: The Shugan survey shows that consumers value device speed/performance twice as much as application availability. Performance is an issue of patents,
not copyrights. That's the basis of our 2:1 ratio of patent damages
to copyright damages.
Re Google Point 2 [?], the point of conjoint analysis is that you
don't need to test every feature; what matters is the relative
importance of features. However, it is important that the most important
features be included. That's why Shugan incorporated two additional
features, price and OS [e.g., Apple/iOS, WebOS, Android]
in the survey in addition to the litigation-relevant features.
[Note that Google pointed out above that the initial focus group
did not rate features, and Oracle doesn't contend it].
Judge: The Cockburn report has multiple uses of the conjoint
analysis. Ignoring features in the analysis might not be valid
for all uses (market share vs the 2:1 calculation).
Oracle: [Something about performance share and market share, and
the mothod used in the survey: participants were given choices
between small sets of phones described as having particular features,
all else supposed to be held contant. Data was then computer
analyzed].
Judge: What about the 24% number? [includes indifference plus illogical
preference numbers.]
Oracle: It's explained in Shugan's report and declarations. It's
not a rater error, or fatal flaw.
Judge: What does the 8.8% mean? [This is the percent of survey respondents
who preferred a phone for $200 over an identical phone for $100.]
Oracle: Shugan uses a "hierarchical Bayesian approach. Uh, Bayes was a mathematician..."
Judge: I know who Bayes was.
Oracle: Anyway, in this method you can't do simple counts of irrational
respondents. You have to look at more complex approaches covered in
the Shugan report.
[Somewhere in here both the Google and Oracle lawyers
admit they're starting to get out of their depth on the math.]
Oracle: Some consumers give irrational answers; that doesn't mean the survey
is irrational.
[I'm not sure from my notes whether the Judge or Oracle made the
next point; I'm pretty sure it wasn't Google. It seems to play right
into showing that survey respondents were not holding all factors equal.]
??: E.g., consumers might associate higher price with increased durability,
or prestige.
Oracle: Shugan redid the study removing the 24%. The results were
only minimally different.
[Google rebuttal of Oracle points:]
Google: I understand why Oracle likes to cite Dr. Cox, but he is
an economist, and these are not legal references. Oracle still
provides no citation of previous use of conjoint analysis to
calculate damages in a courtroom.
Oracle concedes that the most important features should be included
in a conjoint analysis, but their method did not collect consumer
data on what features consumers valued.
[Something about the 24% number again.]
Judge: Google, any other objections?
Google: We'll rest on the briefs.
Judge: I have a question. The Cockburn report is sort of an
algebra equation with
variables, e.g., "patent_value = 2 * api_value". What happens
to this calculation if the jury or patent office knocks out
all the patent claims [or: all claims except for one patent?
Not sure]. Does the conjoint analysis fall apart?
Google: This goes back to the discussion about the two different
uses of the conjoint analysis.
Oracle: Copyright value is independent of patent value.
Judge: I have a question for Dr. John Cooper [a man in the
audience]. If we set the trial date for April XX [I think he
said either 16th or 22nd, not sure, sorry], will the Cooper
report be ready?
Answer: Yes.
[10:23]
Judge: Any last questions on the Daubert motion?
Oracle: Dr. Cockburn is available in the courtroom today.
Judge: Google, do you want to cross-examine Dr. Cockburn?
Google: No.
Judge: We will adjourn, and I'll get an order out. Our 706
expert must get his report ready.
[Adjourned at 10:25 AM]
A 706 expert means the court appointed expert, as in Rule 706.
Update 3: And here's mirrorslap's final report:
Google: The studies are a bad fit for the small selection from the Sun portfolio. Shankerman looked at a particular technology area and looked at how the skew worked across 4 industries (chemical, mechanical, pharmacological, and electronics). The resulting range is different and lower than any other study. (References summary on chart 3, pp. 95-96 in Shankerman report. It shows significantly lower values for patents in particular technological areas.
Judge: What is your answer to
a) Shankerman ad
b) the 14,000 patents?
Oracle: b) 14,000 is worldwide.
Judge: How many in the US?
Oracle: I don't know that number.
Judge: More than 576?
Oracle: Yes. The [subset of the Sun] portfolio is limited [by Oracle] to the tech area of smartphones; they were not chosen according to patent value. Regarding a), electronics have a higher degree of skew than the other 3 areas. The Shankerman survey is a “renewal” survey, which does not break down the value of patents in the top end of the range. It asks: how many patents are worth “greater than x”, not how much are the most valuable patents worth. This apprach tends to flatten the curve at the top. Patent-val is a conservative approach.
Judge: [Getting into the ranking of patents by in-house Oracle/Sun engineers.]
Google: It is fine for Oracle to use in-house people. But what Oracle did was to select patents related to smartphones. They used engineers who are used to prepare for lawsuits, and the engineers were not able to avoid having that mindset.
Barney was a renewal study.
Judge: That sounds like a cross-exam question.
Google: [I missed the response.]
Judge: I will take that as a concession. Next objection.
Google: The main one is “interminacy”. We need an independent significant approach. We (Google) do not want to be in a situation where the values approach the value of the entire portfolio.
Judge: Counsel must stick to the report. I will strike testimony that strays beyond what is in the report.
On cross, the attorneys would be able to open up issues beyond, but at their own risk.
Google: We want to put an upper bound on the values; the Cockburn report specifies “at least”, but no upper bound.
Judge: I have high confidence that the “at least” is the rock-solid basis.
Google: We want to move to a “group and value” approach, where the upper bound depends on the value of the top 3 patents (104, 205, 720). Paragraph 409 of Cockburn's report makes my point: “There is no data -- the 22 patents are equally valuable. References p3 of Cockburn, paragraph 5, line 7 in chart. This leads to a range from $17.7M – 57M.
Judge: What accounts for this [wide] range?
Google: There is no support for the upper bound to articulate that the 104, 205, and 720 patents are the most valuable.
Judge: Looking at my own chart... there are 22 groups and 22 patents. Is there any correlation between the two or is this just a coincidence that the numbers are the same?
Oracle: It is a coincidence.
Judge: This will confuse the jury.
Google: That's not my report [Judge Alsup might have chuckled here.]
Top 22 patents, top 22 technology categories.
Oracle chose to take the top 3 categories.
There is no way to be able to rank the value of the 22 patents.
Citation: p. 105 of Reinholt (sp?) deposition.
“It is intellectually unfeasable to rank the patents.”
Judge: Answer from Oracle?
Oracle: The engineers could not distinguish a ranking of the importance of the patents. [He then points out the difference between an economist (i.e. Cockburn) and an engineer (Oracle/Sun) in assigning rankings.] “In the absence of data, we cannot make a ranking, but on p. 410 of the Cockburn report, he shows how such data is available."
“Google designed Android free from constraint and could have done it in a way that didn't infringe. They chose to use these technologies” [the API to leverage developers and create lots of apps, and the patents to improve speed of loading and multitasking].
Android product description in 2006 was shared with Sun during the negotiations over licensing.
Judge: Are there any internal Google emails that show that Google decided to infringe?
Oracle: Not as such, but Google did choose to use the technology.
Judge: In 2006.
Oracle: Not all of them [the patents]. The '104 yes, that was 2006.
Judge: Google response?
Google: The argument is circular, based on the patents they say were infringed. All Oracle [Sun] had was the Product Description, which had no specifics regarding technologies.
[Missed an interaction here]
Google: The '720 patent was issued in 2008.
[Court breaks for 15 minutes at 9:10AM]
Google: Regarding the “Conjoint survey”
Four objections regarding the Shugan (sp) survey
1) The Conjoin survey is a market research tool for product design, not a tool for assessing damages
2) Shugan's methodology disproves itself. While the consumers who were polled were supposed to [in their minds] vary only one feature, keeping all others the same in expressing preference, 22% opted for a phone that was 2x as expensive with the same features. This makes no logical sense.
3) Based on next-to-last page of Oracle's handout, leaves out critical items, such as choice of network. Shugan selected 7 of 39 features to test:
• app startup time
• # of apps available
• multitasking
• OS choice
• price
• screen size
but didn't select carrier/network or WiFi or camera.
If one is trying to weigh consumer features, by limiting the scope you skew the results.
Judge: Example given of a car with and without a radio.
Google: Exactly. References Apple v. Microsoft under Judge Posner. [explanation missed]
Product that was being tested was a smartphone, and it has hundreds of features.
Respondents were asked to assume that only one feature changed and to express a preference either way, all other features remaining the same. The selection of features to test was done by Dr. Cockburn for Shugan to test. What he is purporting to demonstrate is that consumers would stop buying Android without these features, and the extent to which they would stop.
Judge: Maybe the instructions were not clear enough?
Is the 24% conceded? (paying more for the same feature set) Either the consumer was agnostic or preferred a more expensive phone.
Google: How can a survey that returns such illogical results be trusted?
Final criticism:
1) confidence intervals
2) Shugan said that, due to using a Bayesian estimation/anaysis that confidence intervals cannot be made. This is countervailed by other experts. Oracle rebuttal:
“Conjoint is not appropriate” is nonsense. Google's own copyright damages expert, Dr. Cox, has said that it is indeed used to determine damages. Quoting Exhibit I(?): 2003 “choice modeling” is the same as Conjoint Analysis, and Dr. Cox says that Choice Modeling is “a rigorous methodology for calculating damages”.
Judge: Which of these 7 things measure infringement?
Oracle: Apps availability. Must have an established programming language.
Judge: Language was pled away in this case.
Oracle: API's are copyrighted and Google copied them. These are the API's that developers expect to see.
Judge: How did the number of apps rank to consumers?
Oracle: In 2010, compared PalmOS, Blackberry, Apple at 6K, 40K and 100K apps to determine the effect on Android market share of inability to provide a robust app universe.
Judge: Copyright is one-half [of some part of the damages equation].
Oracle: Speed, memory and performance from patents is in this suit. Shugan shows that incremental speed is 2x as important as incremental # of apps. This speaks to the apportionment and relative value. Dr. Cockburn establishes that the speed and number of apps are important and verifies that these features impact sales.
Turning to chart #4 from Google's presentation: Conjoint Analysis doesn't have to test every feature. Paragraph 25 of opposition brief, Prof. Shugan: ”It is not necessary to test every feature”, but he did include additional items not under litigation: OS (android) and price. The OS is more important than price. There is no declaration that one has to test 36 features.
Judge: Question the validity of the testing, based on the 22% response for more expensive phone. How does Dr. Cockbun use market share?
Oracle: Distinguishes Preference Share vs. Market Share. December report, Shugan assigned a dollar value to patents.
Judge: What about the 24% irrational answers (more expensive phone for the same feature set)?
Oracle: Docket 740 explains why the 24% reference is wrong.
Judge: What is the correct rate of error?
Oracle: 8.8% of responses show preference of more expensive phone with same features.
This test was done using a Hierarchical Bayesian Approach -- you don't test an HBA looking at individual choices. The test is very good at predicting market share changes. Ref: pages 34-44. Says that Google cannot draw this conclusion. There is no testimony from Google to rebut this. The number is not 24%.
In any survey, you get some irrational choices. Consumers are not necessarily rational. Example: status symbol. The Court asked for a recalculation. Docket 740, footnote 44 but for: at least 7.6% lower rather than the [previous?] 7.9% lower sales.
Google: Dr. Cox's finding is not a court case. There is no cited precedent in law for Conjoint analysis. Oracle has created and attacked a straw man. Dr. Leonard (Google) did contravene Shugan in Feb. 24 response.
[Missed some exchanges here.]
Judge: Dr. Cockburn's analysis is like an algebra problem. Half of the
patents-in-suit is the API value (the other half is speed).
What happens if the USPTO knocks out more patents? What then happens to the algebraic representation? Do we then lose apportionment?
Google: Exhibit 37 has percentages.
Judge: Does the other side agree?
Oracle: The value of the copyright is different than the value of the patents.
Judge: Question for John Cooper -- if we set a trial for March 16, will the expert be prepared?
John Cooper: Yes.
Judge: Will it include a critique?
John Cooper: Yes.
Oracle: If there is anything that the Court needs to ask Dr. Cockburn, he is here.
Judge: Google gets a “free shot” to cross-examine.
Google: No.
[ Adjourn 10:25AM ]
I'm sure you join me in thanking both our reporters for such excellent coverage. This may be the hardest hearing we've ever covered, in that patents are so weird anyway, and the lingo is hard to follow, and the details our reporters were able to provide is phenomenal. The judge didn't rule from the bench today, so we'll have to wait for his decision to be published. It does sound like he'll allow some of the report to survive, but it's also apparent that he sees Oracle trying to push for higher numbers than are reasonable.
Update 4: We have the court minutes [PDF] which includes the names of all the lawyers present at the hearing:
For Oracle: Michael Jacobs, Andrew Temkin, Fred Norton, and Steven Holtzman.
For Google: Robert Van Nest, Daniel Purcell, Michael Kwun, Christa Anderson, Bruce Baber, and Renny Hwang.
For the independent Rule 706 expert: John Cooper.
The minutes list Mr. Cooper as being with the defense, but while I would love that, I don't think, judging from the hearing reports, that it's accurate. John L. Cooper is an attorney with Farella Braun & Martel in San Francisco. He's a partner, and he lists this assignment on his page: "Appointed by Judge Alsup, N.D. California to represent a court appointed expert witness in a large patent infringement action between major Silicon Valley companies." He was appointed to represent the Rule 706 court-appointed independent expert, Dr. James Kearl.
Cooper was appointed special master in the Microsoft antitrust case also by Judge Motz, the same judge in the Novell v. Microsoft WordPerfect antitrust trial, and Cooper wrote the amicus brief for Dolby Laboratories, which his bio page says was "cited and followed by the U.S. Supreme Court in Bilski". The brief argued against the machine-or-transformation test as an appropriate test for patentability and that business methods patents are just fine. I don't think the court went that far, but you can read the brief [PDF] and the court's ruling, and make up your own minds. One thing is for sure: the man loves patents, or at least the brief he wrote does.
|
|
Authored by: Kilz on Wednesday, March 07 2012 @ 07:34 PM EST |
Please mention the correction in the title of your post. [ Reply to This | # ]
|
|
Authored by: Kilz on Wednesday, March 07 2012 @ 07:35 PM EST |
For all posts that are not on topic. [ Reply to This | # ]
|
- And, now we see why MONO should never be used by any Free Software Distribution (MS owns .NET) - Authored by: Anonymous on Thursday, March 08 2012 @ 07:26 AM EST
- Louis Vuitton sending a letter over a parody - Authored by: jplatt39 on Thursday, March 08 2012 @ 07:46 AM EST
- Ouch! - Authored by: Anonymous on Thursday, March 08 2012 @ 07:14 PM EST
- Don't forget your umbrella! - Authored by: JamesK on Thursday, March 08 2012 @ 10:24 AM EST
- Raspberry Pi + Manufacturing hiccup = delay - Authored by: Anonymous on Thursday, March 08 2012 @ 10:39 AM EST
- Off Topic - ACTA - How to un-ratify a treaty - Authored by: Anonymous on Thursday, March 08 2012 @ 11:06 AM EST
- re: Apple suing the sun in Germany! - Authored by: Anonymous on Thursday, March 08 2012 @ 11:41 AM EST
- Higgs boson can’t hide: ‘end-game’ approaching in hunt for ‘God particle’ - Authored by: JamesK on Thursday, March 08 2012 @ 04:17 PM EST
- Jim Clark: Microsoft's attempt to break into the phone industry “brain-dead” - Authored by: Anonymous on Friday, March 09 2012 @ 04:12 AM EST
|
Authored by: Kilz on Wednesday, March 07 2012 @ 07:36 PM EST |
Please mention the name of the news story in the top post. [ Reply to This | # ]
|
|
Authored by: Kilz on Wednesday, March 07 2012 @ 07:37 PM EST |
Please list anything you have done to help PJ with this important work. [ Reply to This | # ]
|
|
Authored by: feldegast on Wednesday, March 07 2012 @ 07:40 PM EST |
Thank you, it is great to have someone let us know what
happens at hearings!
---
IANAL
My posts are ©2004-2012 and released under the Creative Commons License
Attribution-Noncommercial 2.0
P.J. has permission for commercial use.[ Reply to This | # ]
|
- Thanks Steve n/t - Authored by: Kilz on Wednesday, March 07 2012 @ 07:54 PM EST
- Seconded (or thirded or whatever) - Thanks, Steve! (n/t) - Authored by: FamilyManFirst on Wednesday, March 07 2012 @ 08:02 PM EST
- Thank you Steve Finney for attending - Authored by: norahc on Wednesday, March 07 2012 @ 08:49 PM EST
- Thanks To Both Attendees... - Authored by: lnuss on Wednesday, March 07 2012 @ 08:54 PM EST
- Thank you both for attending - Authored by: Anonymous on Wednesday, March 07 2012 @ 09:51 PM EST
- Thanks to both of you - Authored by: Ian Al on Thursday, March 08 2012 @ 03:29 AM EST
- Thank you Steve Finney for attending .... - Authored by: globularity on Thursday, March 08 2012 @ 05:05 AM EST
- Thank you Steve Finney for attending - Authored by: Anonymous on Thursday, March 08 2012 @ 07:25 AM EST
- Thank you Both for attending! - Authored by: celtic_hackr on Thursday, March 08 2012 @ 01:28 PM EST
- Thank you Steve Finney for attending - Authored by: charlie Turner on Thursday, March 08 2012 @ 02:50 PM EST
- Thank you Steve Finney for attending - Authored by: Anonymous on Thursday, March 08 2012 @ 03:22 PM EST
- Thank you for attending - Authored by: NigelWhitley on Friday, March 09 2012 @ 04:53 AM EST
|
Authored by: Anonymous on Wednesday, March 07 2012 @ 07:40 PM EST |
Thank you for the report Steve!
-Tom from Detroit[ Reply to This | # ]
|
|
Authored by: Steve Martin on Wednesday, March 07 2012 @ 07:58 PM EST |
I just snuck a peek at PACER, the minute entry for today lists the attorneys
present on each side:
Plaintiff Attorney(s): Michael Jacobs; Andrew
Temkin; Fred Norton;; Steven Holtzman
Defense Attorney(s): Robert Van
Nest; Daniel Purcell; Michael Kwun; John Cooper
Christa Anderson; Bruce Baber;
Renny Hwang
--- "When I say something, I put my name next to it." --
Isaac Jaffe, "Sports Night" [ Reply to This | # ]
|
|
Authored by: Anonymous on Wednesday, March 07 2012 @ 09:47 PM EST |
The "top 10%" argument makes sense if Sun's main patent
portfolio "filler" is Java. But even if not, this is a very
selective choice of patents (<5%) out of the portfolio, so to
compare it with industry-wide curves seems misleading at best.
Not to mention that the "sorting" of the patents was hardly
done by an independent third party...
Just wondering: As many of the asserted claims in the asserted
patents have failed re-examination, would that not belie the
assumption that they are the most valuable?[ Reply to This | # ]
|
|
Authored by: Anonymous on Wednesday, March 07 2012 @ 10:30 PM EST |
Oracle: The Shugan survey shows that consumers
value device speed
twice as much as performance. Performance
is an issue of patents, not
copyrights. That's the basis of
our 2:1 ratio of patent damages to copyright
damages.
Really?! THAT is the basis?! To summarize:
- Make
a survey choosing features mostly used for
litigation (not necessarily features
that consumers value
most)
- Compare highest-rater "patent" and highest-rated
"copyright" feature, see that they are roughly 2:1. Ignore
everything else the
survey says.
- Take this 2:1 figure and apply to damages valuation
That
is just guesswork/voodoo, not math. I really hope this
does not go
through.
~cd[ Reply to This | # ]
|
- yeah that line through me off too - Authored by: designerfx on Wednesday, March 07 2012 @ 11:01 PM EST
- That is just guesswork/voodoo, not math. Agreed - Authored by: SilverWave on Thursday, March 08 2012 @ 02:13 AM EST
- Misquote - Authored by: ailuromancy on Thursday, March 08 2012 @ 02:46 AM EST
- Misquote - Authored by: PJ on Thursday, March 08 2012 @ 10:08 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 10:48 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 10:53 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 10:56 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 11:44 AM EST
- Misquote - Authored by: stegu on Thursday, March 08 2012 @ 07:24 PM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 10:53 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 10:58 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 11:39 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 01:03 PM EST
- Misquote - Authored by: PJ on Thursday, March 08 2012 @ 01:30 PM EST
- Misquote - Authored by: awkScooby on Thursday, March 08 2012 @ 02:03 PM EST
- what language are APIs written in? - Authored by: Anonymous on Thursday, March 08 2012 @ 03:51 PM EST
- what language are APIs written in? - Authored by: PJ on Friday, March 09 2012 @ 02:11 AM EST
- what language are APIs written in? - Authored by: Anonymous on Friday, March 09 2012 @ 07:52 AM EST
- what language are APIs written in? - Authored by: Anonymous on Friday, March 09 2012 @ 09:20 AM EST
- Disagree... - Authored by: Anonymous on Friday, March 09 2012 @ 09:43 AM EST
- Addendum - Authored by: Anonymous on Friday, March 09 2012 @ 09:58 AM EST
- Addendum - Authored by: Anonymous on Friday, March 09 2012 @ 11:09 AM EST
- Disagree... - Authored by: PJ on Friday, March 09 2012 @ 10:07 AM EST
- Disagree... - Authored by: Anonymous on Friday, March 09 2012 @ 10:39 AM EST
- Disagree... - Authored by: Anonymous on Friday, March 09 2012 @ 11:14 AM EST
- Disagree... - Authored by: Anonymous on Friday, March 09 2012 @ 11:26 AM EST
- Disagree... - Authored by: Wol on Friday, March 09 2012 @ 04:37 PM EST
- Disagree... - Authored by: Anonymous on Sunday, March 11 2012 @ 12:52 PM EDT
- Disagree... - Authored by: Anonymous on Friday, March 09 2012 @ 08:13 PM EST
- Disagree... - Authored by: awkScooby on Friday, March 09 2012 @ 01:53 PM EST
- copyrightable arrangment - Authored by: Anonymous on Friday, March 09 2012 @ 10:13 AM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 05:17 PM EST
- Misquote - Authored by: stegu on Thursday, March 08 2012 @ 07:40 PM EST
- Misquote - Authored by: Anonymous on Friday, March 09 2012 @ 07:27 PM EST
- APIs are a sort of form - Authored by: Anonymous on Thursday, March 08 2012 @ 07:58 PM EST
- API Example - Authored by: awkScooby on Friday, March 09 2012 @ 03:02 PM EST
- A quick study in trigonometry ... - Authored by: Wol on Thursday, March 08 2012 @ 02:20 PM EST
- Misquote - Authored by: Anonymous on Thursday, March 08 2012 @ 09:21 PM EST
- 2:1 basis - Authored by: ais523 on Thursday, March 08 2012 @ 07:05 AM EST
- 2:1 basis - Authored by: Anonymous on Thursday, March 08 2012 @ 10:26 AM EST
|
Authored by: norahc on Thursday, March 08 2012 @ 12:44 AM EST |
Judge: You have 3 sample [patent] portfolios. No one
doubts that
these curves have a disproportionate value at the ends.
But Dr. Cockburn is
trying to derive huge amounts based on 3 data
points. When you get down to
1% [of the most valuable patents],
the numbers aren't even close, and some
statisticians would treat them
as outliers. But Dr. Cockburn is using them as a
basis. Looking at
the wide variation in the curves at the top of their
range. We are not
talking about the top 20% [where the curves apparently are
somewhat
in agreement], we are looking at the top 1% [of some 576 patents].
Don't we need more data [to have a statistically significant result]?
Aren't
we looking at the tail, or the tiny tip of the tail? I see absolutely
zero
analysis of this from Dr. Cockburn.
It would seem that the judge
is more knowledgeable about statistics
than I would have expected.[ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 01:12 AM EST |
Oracle is arguing that more application developers are developing for Android
because they are familiar with the APIs. I would agree that there is a great
number of Java developers. However, I doubt that there were more Objective C
developers in existence at the time the iPhone came out, and that didn't seem to
detract from the number of applications developed for the iPhone, which
continues to have more applications than Android.
Additionally, while the code for Android is written in Java, the APIs to do
things are quite different than Java. Much of Android is based around resources
and interprocess communication, none of which is based on the Java APIs. Yes,
things like containers and iterators remain common with Java, but that's rarely
the majority of software for Android.[ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 01:27 AM EST |
"I can't believe that you thought I'd be dumb enough not to
notice that you'd left out Barney" - without a doubt the best
quote from the judge for the day :-)[ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 01:44 AM EST |
Who is Mr Cooper?
From the exchanges, it sounds like he is an independent expert
brought in by the court to give his own damages/value report.
That would be a very smart move by the judge.[ Reply to This | # ]
|
|
Authored by: SilverWave on Thursday, March 08 2012 @ 01:50 AM EST |
"The 569 patents in the narrow portfolio are already in the top 10% [of
value] in the 14,000 patent portfolio."
Killer point.
---
RMS: The 4 Freedoms
0 run the program for any purpose
1 study the source code and change it
2 make copies and distribute them
3 publish modified versions
[ Reply to This | # ]
|
|
Authored by: SilverWave on Thursday, March 08 2012 @ 01:52 AM EST |
Judge: I can't believe that you thought I'd be dumb enough not to notice that
you'd left out Barney.
Ouch!
---
RMS: The 4 Freedoms
0 run the program for any purpose
1 study the source code and change it
2 make copies and distribute them
3 publish modified versions
[ Reply to This | # ]
|
|
Authored by: SilverWave on Thursday, March 08 2012 @ 02:10 AM EST |
Waiting 90 day would have been ... bad.
---
RMS: The 4 Freedoms
0 run the program for any purpose
1 study the source code and change it
2 make copies and distribute them
3 publish modified versions
[ Reply to This | # ]
|
|
Authored by: SilverWave on Thursday, March 08 2012 @ 02:26 AM EST |
That is from a "games theory" prospective..
...by not being bluffed and put off by his threats to throw out the report, they
now look to have forced him to accept lots of the dubious things the report
originally contained.
The only good thing the threats did was to reduce the starting figure down to
100million...
hmmm
---
RMS: The 4 Freedoms
0 run the program for any purpose
1 study the source code and change it
2 make copies and distribute them
3 publish modified versions
[ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 02:35 AM EST |
Lawyers (and the judge) pretending to be mathematicians, but discussing the
value of software patents. Something's very wrong with this picture. [ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 04:31 AM EST |
for that depth of detail. It allows me to believe this judge is going
to great lengths to minimise the amount of garbage that will be
fed to his jury.[ Reply to This | # ]
|
|
Authored by: ionic on Thursday, March 08 2012 @ 04:45 AM EST |
Is it time for a new canonical thread titled "Barney"? It could be
used to highlight the most specious of arguments raised by counsel / other
actors in whatever teh article is discussing
[joke - I think!][ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 05:06 AM EST |
Oracle argues that these five patents are the most valuable in their entire
portfolio. That would be the five patents that the patent office is in the
process of declaring to be (mostly) invalid. Looks to me like Oracle is arguing
here that their entire patent portfolio is pretty much worthless. [ Reply to This | # ]
|
|
Authored by: Ian Al on Thursday, March 08 2012 @ 06:27 AM EST |
I would like to, but, I won't insult your intelligence.
However, I am
the acknowledged expert in auto analogies and, in court, both defendant and
plaintiff have opened up this issue for examination.
Oracle: The
Shugan survey shows that consumers value device speed/performance twice as much
as application availability. Performance is an issue of patents, not copyrights.
That's the basis of our 2:1 ratio of patent damages to copyright
damages.
Judge: Which of these 7 things measure
infringement?
Oracle: Apps availability. Must have an established
programming language.
Judge: Language was pled away in this
case.
Oracle: API's are copyrighted and Google copied them. These are
the API's that developers expect to see.
Google
designed Android free from constraint and could have done it in a way that
didn't infringe. They chose to use these technologies” [the API to leverage
developers and create lots of apps, and the patents to improve speed of loading
and multitasking].
Android product description in 2006 was shared with
Sun during the negotiations over licensing.
Judge: Are there any
internal Google emails that show that Google decided to infringe?
Oracle: Not as such, but Google did choose to use the technology.
Judge: In 2006.
Oracle: Not all of them [the patents]. The '104 yes,
that was 2006.
Google: The argument is circular, based on the patents
they say were infringed. All Oracle [Sun] had was the Product Description, which
had no specifics regarding technologies.
Just to translate Judge
Alsup's question, 'does the Lindholm email amount to a hill of
beans?'.
I hope I have got this right, but the standard appears to be
that the plaintiff establishes the full damage possible from the asserted
infringement and the defendant has to establish what factors reduce that figure
to the actual damage.
In Google's opposition to Oracle's third report
we get:
The evidence demonstrates that the success of the Android
architecture is almost entirely, if not entirely, due to Google. At the very
least this evidence, weighed against the evidence provided by Dr. Cockburn,
indicates that Dr. Cockburn's measure of the contribution of the API claim is
too speculative to merit an award of
damages.
and,
Though apportioning profits based on
this 10% figure does not directly measure the exact portion of Google's profits
that are attributable to the alleged infringement, Dr. Cox explained that this
approach allows him to "estimate the proportion of the revenue attributable to
the relevant APIs.". This is true because even though the 2006 bundle of
intellectual property rights is not the same as the actual 2011 Android
platform, that does not mean that there is no relationship between them. Given
Dr. Cox's opinion that most or all of Google's profits are attributable to
factors other than the alleged infringement, he is entitled to rely on this
evidence, because it "may rationally be used as a springboard" for an
apportionment. (Cream Records),
The conjoint analysis
assumes that all application availability was derived from the use of the Java
APIs. However, Oracle claim that only elements of 37 packages (out of 160+) were
infringed. Oracle does not apportion the value the allegedly infringed, copied
API elements compared with the value of the totality of elements. Only the
allegedly infringed elements are relevant to damages calculated on the basis of
availability of apps. Neither does the analysis take into account that an app
written in Java does not necessarily use all or any of the allegedly infringed
elements.
Oracle maintain that it is the 'the selection, arrangement,
and structure of the APIs' that is protectable. Does the conjoint analysis take
into account whether the protectable part of the APIs are in the allegedly
infringed elements that Google allegedly copied from the API and how much, if at
all, this contributes in any way to app availability? Judge Alsup specifically
asked for the selection, arrangement, and structure of the APIs to be covered in
the brief for this hearing.
I have looked for two quotes from the Cox
report, without success, but from memory they can be summarised as 'most major
apps are not written in the Java language'. Again, the conjoint study assumes
that all apps are written in Java and use the infringed elements and that there
are none that are not written in Java and/or do not infringe the Java language
APIs.
There is no evidence that the accused devices contained any apps
written in Java. Thus, the proven damages to date from the accused devices are
zero. The payments for future years has to be based on the proportion of apps
and their intrinsic value written in the Java language and the extent that they
used any or all of the allegedly infringed selection, arrangement, and structure
in the allegedly copied API elements. We still don't know from which Oracle,
copyright-protected document Google are supposed to have copied.
Enough
of this and on to the auto analogy!
The APIs and the patents are
methods of making a VM and of making components to run in the VM. Let's make an
auto the analogy of the virtual machine. Google are accused of inciting the use
of a patent infringing machine tool to make the auto and to make the optional
radio installed in the auto (my analogy of the apps). What statistical
confidence can we have that the machine tool actually made any difference to the
speed and performance of the auto or the number of channels the radio can pick
up? Can conjoint analysis reveal the effect on customer buying decisions of the
incitement to a third party to use the infringing machine tool?
Google
incited the use of the infringing machine tool. Are they liable for goods
produced by a third party using that infringing machine tool, no matter how
many, or few, or valuable the goods produced? Google are in the position of an
auto distributor in that they benefit financially if they can improve on the
customer desirability of the autos they sell. What statistical analysis of their
auto distributor profits shows the damage caused by their alleged incitement to
use the infringing machine tool and what is the Google liability? What is the
legal precedent for this?
--- Regards
Ian Al
Software Patents: It's the disclosed functions in the patent, stupid! [ Reply to This | # ]
|
|
Authored by: NigelWhitley on Thursday, March 08 2012 @ 07:40 AM EST |
The interchange between Google and Judge Alsup regarding the portfolio of
patents seems interesting (IMHO, IANAL). Google suggest that the study is not
comparable because, instead of the entire 14,000 patents in the Sun Portfolio,
Dr Cockburn is looking at only a selected 569(or 579).
There have been previous posts about the importance of a sample being
representative when drawing inferences about a larger population. In this case,
Dr Cockburn is using the result of studies from some sample(s) of the world's
patents to calculate the value of these particular patents. The underlying
assumptions here are that the other samples are representative of patents as a
whole AND that these particular patents are from a representative sample of
patents as a whole. It is this latter part which Google appears to be
disputing.
This relates to one of the fundamental claims of Dr Cockburn's report (based on
the other studies) : that the value of patents within a portfolio is heavily
skewed. Forgive me if the meaning is obvious to everyone, but what this amounts
to is that the value of patents is not like fresh snow lying over the body of a
field - roughly even throughout. It naturally forms "drifts" at the
edge like snow against the sides of walls, where there may be relatively little
snow away from the wall but a steep upward slope at the end. The bit against the
wall is a relatively small proportion of the area of the field but it has a far
higher concentration of snow. Replace value for snow and number of patents for
area. The other studies essentially looked at the distribution of snow across a
whole field including the wall.
Google appear to be suggesting (based on the reports) that, in selecting the
smaller group of patents, Oracle has already eliminated many of the
"worthless" patents from the whole Sun portfolio. To return to the
analogy, they've ignored most of the field and focused on a section close to the
wall. Dr Cockburn has then (as Google appear to be suggesting) made inferences
about the distribution of the snow across that much smaller section as though he
were actually looking at the whole field. Clearly, that would not be appropriate
as the section against the wall constitutes a far higher proportion of the
smaller area and the upward curve would therefore be relatively shallower.
Oracle say that they didn't select their 500+ patents based on economic value,
but on engineering applicability. But IMHO, economic value is not completely
independent of engineering value. To put it simply, a worthless patent in
engineering terms is likely to be worthless in economic terms too. If the Judge
leans towards Google and finds the methodology of using a selected sample is
inappropriate then it gives him cause to reject the report, or at least chunks
of it. IANAL, but the Daubert stuff seems to be about making sure the jury isn't
fed junk information purporting as science. Faults in methodology seem to fit
that slot quite neatly.
The other bit I noted was where Judge Alsup seemed to ask about a confidence
interval across the studies and was told (by Oracle) that the sample size was
too small for that. In this case I believe that sample size is of the studies
themselves not the number of patents. So we have only three studies to gauge
how reliable Dr Cockburn's figures are. This is a particular problem for the
Judge because we are talking about one edge of a skewed distribution - the tip
of the tail. Using the earlier analogy, this is akin to measuring just the snow
in the crevices of the wall. So, take the results from a wall in each of
Vermont, Colorado and Ilinois, assume that's representative of all the world and
guess how much snow ended up against a wall in Alaska (and for a wall you've
chosen because it may have collapsed due to the snow against it). To quote Judge
Alsup "You're not convincing me".
This is the bit where I get told I don't know what I'm talking about :-D.
-------------------
Nigel Whitley[ Reply to This | # ]
|
|
Authored by: Anonymous on Thursday, March 08 2012 @ 10:18 AM EST |
Google:Shugan said that, due to using a Bayesian
estimation/anaysis
that confidence intervals cannot be made.
LOL! Technically
true by Google because in Bayesian
statistics does not have confidence
intervals are
called
credible intervals. But are really rather
different and
do not
have the same interpretation due to the differences
between
the usual (Frequentist) statistics and Bayesian
statistics. It
is a major error to equate these but then
lawyers and Judges are not publishing
statistical papers. So
Oracle got a major pass on not having to explain
what
Bayesian statistics is when asked What does the 8.8%
mean? when
asked by the Judge. It does not represent
the average but
that average
modified by some prior information.
Surprising that if the Judge really knew
who Bayes
was then he did not dig deeper. Sure not his job to
destroy
Oracle's position but, as seems to be part of his
style (or excuses), if he
does not understand it, then how
can the jury understand it?
Also I was
somewhat
surprised here that Google did not challenge the
"hierarchical
Bayesian analysis". This requires the joining
of some prior beliefs (called
priors) and what the data is
saying. Unless the data is sufficiently strong,
the prior
belief's can have a major impact on the outcome. Thus, if
things do
not change when you change the input data then it
strongly suggests that your
prior belief is inappropriate
and must be changed. Thus, if we go to court,
then I expect
Google to attack that part of the Shugan report. [ Reply to This | # ]
|
|
Authored by: caecer on Thursday, March 08 2012 @ 10:44 AM EST |
Perhaps some of Judge Alsup's outlook and pronouncements (e.g."I know who Bayes
was.") can be better understood when one realizes that he is a
mathematics graduate from Mississippi State University. [ Reply to This | # ]
|
|
Authored by: PTrenholme on Thursday, March 08 2012 @ 01:09 PM EST |
Perhaps off topic, but the copyrights are still in play
in the Oracle v.
Google case. So:
An argument that might be useful in a jury
trial.
1. A "computer" is an electronic device used to find the
results
of a computation. (The "result" might be "turn on a
pixel at some specific
place on a display screen" or
"increase the temperature setting by 20 degrees,"
but those
kinds of things are still the result of some computation.)
2.
Software is used to create the instructions guiding a
computer's
actions.
3. Therefore software creates the instructions that let a
computer find the results of a computation, and how results
are computed is
mathematics.
I think that argument is simple enough to convince
most
eight year old children, but IANAL, so I don't know -
and can't guess - how a
jury, judge, or higher court would
react to a simple appeal to semantics and
logic. (I suppose
some "expert witness" would be needed to establish that a
"computer" really only does computations.) --- IANAL, just a
retired statistician [ Reply to This | # ]
|
|
Authored by: celtic_hackr on Thursday, March 08 2012 @ 01:41 PM EST |
Although the Java language is free to use, the API's are
copyrighted.
Umm. I don't know really how to respond to this.
If the language is free to use, then in order to use it you have to use the
syntax of the language and the words of the language. Google didn't use the
APIs, they merely copied the syntax of the APIs. The Android APIs are in Dalvik.
The Java APIs expose the language. Hence in order to "use" Java, you have to
copy the APIs.
So Oracle wants to put in a Catch-22 here. You can use
the language, but you can't use the APIs. But you can't use the language, unless
you use the APIs.
[ Reply to This | # ]
|
- I'm so confused.... - Authored by: Anonymous on Thursday, March 08 2012 @ 01:59 PM EST
- This is why lawyers should not make statements which mught be confused for expert testimony - Authored by: Anonymous on Thursday, March 08 2012 @ 04:13 PM EST
- This is why lawyers should not make statements which mught be confused for expert testimony - Authored by: Anonymous on Thursday, March 08 2012 @ 05:05 PM EST
- The language is worthless without the APIs - Authored by: jbb on Thursday, March 08 2012 @ 08:26 PM EST
- I agree - Authored by: celtic_hackr on Thursday, March 08 2012 @ 11:18 PM EST
- The language *doesn't* *exist* without the APIs - Authored by: BitOBear on Friday, March 09 2012 @ 04:45 AM EST
- The language does exist without the APIs - Authored by: stegu on Friday, March 09 2012 @ 06:00 AM EST
- The language - Authored by: Anonymous on Friday, March 09 2012 @ 06:04 AM EST
- Nope - Authored by: BitOBear on Friday, March 09 2012 @ 06:15 AM EST
- Nope? - Authored by: Anonymous on Friday, March 09 2012 @ 06:25 AM EST
- Nope - Authored by: BitOBear on Friday, March 09 2012 @ 06:33 AM EST
- Nope - Authored by: Anonymous on Friday, March 09 2012 @ 06:40 AM EST
- APIs and ABIs - Authored by: Anonymous on Friday, March 09 2012 @ 06:09 AM EST
- Would you write a database application that could be claimed to use an Oracle owned API? - Authored by: Ian Al on Friday, March 09 2012 @ 07:26 AM EST
- This is why lawyers should not make statements which mught be confused for expert testimony - Authored by: mirrorslap on Friday, March 09 2012 @ 12:37 PM EST
|
Authored by: BitOBear on Friday, March 09 2012 @ 04:21 AM EST |
So if I understand the real problem here, its that the fitting the curve to the
patents is an act of simple division. Where the curve is low it should eat the
bulk of the patents. But Oracle has pre-discarded a whole bunch of the patents
in their portfolio to construct a "sub-portfolio" over which to
apportion the cash represented by the $100M.
Now if they had thrown all their 14,000 patents into the air and selected the
597 at random, there -might- be a fit to the curve based on the principles of
randomness. Then again there might not. But there might be.
But oracle cut the prime meat out. They cut the beef tips off. They want to
ignore the cow and just discuss the best parts. As if the flank steak, skirt
steak, stomach and tongue were just noise that would be given away for free.
In short,they seem to be trying to claim that the upward pointing last 1.5% of
the graph (597 entries) of the list would have *the* *same* curve as full graph,
including the nice flat part of the least-valuable ninety percent (12,000
entries or so).
It's mathematically insupportable.
Even if the 597 were semi-distributed and were just selected by their
"likely relevance" (e.g. these are just the electronics-related
patents we [oracle] *think* they [google] would have wanted), it disclaims the
fact that they were *offering* 14000 elements for license/sale. That they are
now claiming that they can *tell* in after-thought which patents would have been
the ones used is "hokum".
By simple math X/100 = 597/14000 does not leave X equal to 100.
The court and all parties must first distribute the 14,000 over the whole curve
then elide the area under the curve covered by the patents not at issue,
discarding the money for the elided area. *That's* the value of the deal versus
the patents at issue.
Since Oracle is only now suing over a scant handful of those patents, no matter
how they were distributed. the act of taking the 3 surviving patents over the
curve of 14000 patents makes the surviving value trivial if there is any curve
at all. If you can fit just 30 patents into the "good end" of the
curve, that there are only 3 patents in suit indicates that at most $10M would
be available as damages (30/3 10% of the most valuable 30, where 30 are presumed
to "eat up" the entire value of the $100M original deal).
The more patents you add the worse it becomes for Oracle.
The thing missing from all this is the fundamental truth of statistics: No one
statistic is useful, they are only useful in comparison.
If google could find N other licensees of Sun patents that did not include the
patents being sued over, then they should be able to state outright that those
license values shoudl be subtracted from the total $100M Sun/Oracle is asking
for. After all, that demonstrates patent value for patents from the original
deal that are *not* in suit.
The real truth is that the "value" of a patent is much like the value
of any "collectible", its worth what someone is willing to pay. Google
was willing to pay nothing. I am not just being smug here. If the patents have
*absolute* value, as opposed to "pay me or I'll sue value" then the
value of each patent Oracle *didn't* pre-select should be removed by simple
*subtraction* instead of being anonymously distributed over a curve.
Again the legal system has created a Quantum Object, the value of the patent
being uncertain until viewed by a particular patent lawyer.
Asking this "value" to then be redistributed along a curve based on
apparent applicability is just bad math, and no mathematical formula *can* issue
to make it true. After all, if they were suing Microsoft, it would be a
different set of patents they would be putting "at the tip of the tip of
the tail" right?
So they are treating the patents as interchangeable along the curve, but only
when it comes to saying, moment to moment, which one(s) they are going to say
are at the high-value point.
If they want to pull this curve nonsense off, they should be required to declare
the absolute order of the patents along the curve, publish that, and stick to it
for all future cases and licenses.
Shorter: if they are going to claim this valuation theory they need to list
every single patent they have as patent A more valuable than patent B more
valuable than patent C for each and every patent in the portfolio. That's the
only way to do it.
Analogy: I regularly play "table top role-play games" like D&D,
pathfinder, etc. In the course of play you eventually roll dice to
"attack" things (etc.). If I have a character and I am attacking with,
say, a rapier and a dagger, and I roll two dice at the same time and declare the
rapier hit successfully and the dagger missed, was it honest? In real play you
are either required to do the attacks one at a time or to use two dice that can
be told apart easily and before you roll you say which dice is for which action
(say a green and a red die and saying "the red die is the rapier").
This *matters* because the rapier is a "nastier weapon" than the
dagger in the system, so the temptation to just pick the successful die and
assign it to the best weapon is immense.
So even if Oracle gets the whole curve thing in, they are still guilty of
assigning '105, '204, and '720 to the "sweet results", e.g. the pointy
tip of the tip.
Current results suggest that these patents have already taken a thrashing, that
they deserve to be at the lame low-value end of whatever graph is drawn.
Even if the methodology of the curves is *excruciatingly* correct, no evidence
has placed the patents at issue anywhere along the graph in particular.
Child's Riddle: how do jump off a one-hundred foot ladder and not get hurt? Jump
off the lowest rung.
I see a lot of ladder coming into court, but I don't see anybody demonstrating
what rung the patents at issue are supposedly to standing on.[ Reply to This | # ]
|
|
Authored by: BitOBear on Friday, March 09 2012 @ 05:37 AM EST |
Hey google, I bet you wish you had just crammed a python interpreter into your
phones... 8-)
Okay, got that out of my system (and I don't even *like* python as a language
because I know white-space isn't a first-class control structure).
I know, nobody ever listens to a Prophet in his own time, but pay more attention
to RMS.
Now, all *that* said...
I don't see how using Dalvik has any basis to the apportioned 2:1 value of the
copyrights (etc) from using Java. The audience surveyed wanted bulk in choice
applications, and Oracle is saying that choice was brought forth by the use of
Java (ne Dalvik).
I don't see it. I have been poking around in the development API for Android and
you don't use SWING or any of the java-ness of java to achieve your application
availability or density.
The four core system-level abstractions in Android do not occur in Java at all.
Java has Application and Applets; Android has Activities, Services, Content
Providers, and Broadcast Receivers. (It's even a whole power-of-two different in
magnitude in terms of platform-to-program cardinality.)
I cannot take a program for Android and compile it in Java run-anywhere without
there being an emulator layer or some junk.
A whole third of the case value hinges on this idea that it was *Java* per-se
that gave you a leg up. Technically it was Dalvik that did that, and even then,
neither platform created the installation and inter-operation paradigm that lets
Android offer large numbers of applications easily.
Rapid stable release of code and proper sandboxing for stability is an almost
completely language-independent.
So since "surveys" are now "evidence", you need to take a
survey of your developers and fans:
(1) Would you develop for Android in Python?
(2) Would you have *avoided* development for Android if it *didn't* use the Java
API?
And a second survey of the world in general
(1) did you ever decide *not* to write an Android application because you would
have had to use Java?
---
The fact of the matter is that Android took off because it was open source and
it didn't have the Apple-induced barriers to entry.
None of the developers *care* about how java like it is, and I suspect you can
prove that in court.
The only reason that Google used anything java-like seems to be that Google has
an institutional bias to the java language. (If you come in with C++ skills for
a job interview at Google you get the strong whiff of "how fast can we get
you over to java", right down to the code samples taped up over the urinals
for people to ponder while they pee.)
So dalvik was chosen, it was chosen not in the names of all the developers who
have since landed apps in the app store, but because it saved Google a trivial
internal expense of picking another language before writing an entire framework
over the base.
But seriously, if you had picked Python, or TCL/TK, or erlang, or god knows how
many other languages; virtually anything other than Java and Mono in fact; you
wouldn't be in this mess.
I hope that internally Google has started *fleeing* Java whole-scale. If not,
Oracle should be coming knocking any second to look into your use of Java for
ad-words... It makes just as much sense to sue you for that usage as Android...
But in terms of a legal strategy, get them to hump up on the Java copyrights and
then prove in court that Java just *isn't* an Android selling point.
In fact, I *personally* have avoided writing several apps, tempted though I was,
because Java makes me barf up a little in the back of my throat. So there are
two lost apps right there *because* you used Java.
Oracle's first predicate valuation is based on the idea that if it *weren't* for
Java there would be *no* Android. This assertion is false on its face. The only
thing that would have left you at ground-zero is if there had been no Linux
Kernel.
Oracles second predicate valuation is base on the idea that if it *weren't* for
Java, you would *not* have a developer community. This one can be disproved by
survey.
So the "Google Valuation" of the patents and copyrights at suit is the
trivial expense of picking some other reasonably popular language like Python
before writing an systems framework for *that*.
Just sayn...[ Reply to This | # ]
|
|
Authored by: BitOBear on Friday, March 09 2012 @ 09:47 AM EST |
Going back to surveys...
Go ahead and find out ho much the people would pay for the Android device if it
had no connectivity at all.
None of the selective Oracle surveys included "how much would you pay
-now-" with things like SMS, voice calling, USB cables, portability,
camera, SD-card, and network connectivity removed.
Seriously, the -unconnected- pocket organizer marked is in the tens of dollars.
Without the phone, the smart-phone market is nonexistent. Even the PSP et al
have WiFi or something now days.
Nobody would pay anything for, say a 11x17 Android tablet that could only
interract with the world via a barcode reader and a built-in floppy drive.
Without the phone part nobody would pay the $200 -or- the $100.
Additionally, the whole price point thing between the 100 and 200 value proves
that functionality is, on average, less than half of what sells phones. It's all
brand recognition and "flash".
Do a survey of android owners. Find out how many of them even have a -clue- that
there is anything java-like in the things. Ask them if they bought it for its
java tidbits. Push the survey out through the Google Play service as a free quiz
with a bunch of questions, some of which are relevant and some are noise and use
that to show that "the market" has no idea what it wants and why it
bought what it bought.[ Reply to This | # ]
|
|
Authored by: Anonymous on Friday, March 09 2012 @ 05:58 PM EST |
This case is garbage from top to bottom. If I ever become supreme dictator,
better watch out because all patent attorneys will be first against the wall!!
But seriously, its ridiculous that Google even has to fight this case. It must
be obvious to everyone now why the U.S. is falling behind in technology fields.[ Reply to This | # ]
|
|
|
|
|