Showing posts with label patents. Show all posts
Showing posts with label patents. Show all posts

Saturday, April 21, 2018

Fascinating Lecture on Uncovering Insight from Patent Data Using Text Mining with Applications to Cybersecurity

Yesterday, Dr. Davit Khachatryan, who is an Isenberg School PhD alum in Management Science, and now is a Professor at Babson College, gave a captivating lecture in our UMass Amherst INFORMS Speaker Series. The title of his talk was: Uncovering Insight from Patent Data Using Text Mining.

Prior to joining the faculty at Babson College, Davit was a Senior Associate at the top consulting company, PWC. It was a pleasure to welcome a very successful alum back to campus! Davit was the 8th and final guest speaker in our series for the 2017-2018 year. This year we had the pleasure of hosting Professor Renata Konrad of WPI, Professors Shannon Roberts and Hari Balasubramanian of UMass Amherst, Professor Dmytro Matsypura (also an Isenberg School PhD alum and my former doctoral student) from the University of Sydney in Australia, Dr. Les Servi of MITRE, Professor Jim Orlin of MIT, and Professor Burcu Balcik of Ozyegin University in Turkey. As the Faculty Advisor to the award-winning UMass Amherst INFORMS Student Chapter, I help the students to organize this Speaker Series, which adds tremendously to the intellectual life of the Isenberg School and UMass Amherst and also provides leadership and networking opportunities for the students. After each talk, I host a lunch at the UMass Amherst University Club so that we get to know the speaker(s) in a relaxing manner and continue the discussions.

Deniz Besik, the President of the Student Chapter this year, introduced Professor Khachatryan and then he began his lecture.
He provided us with a fascinating introduction to the patenting process in the US, dating back to President George Washington and noted that the first patent in the US was issued in 1790 to Samuel Hopkins and it was signed by Washington. The first business processing patent was given to Herman Hollerith in 1889 and then the company was renamed as IBM.

There were more than 100 million patents issued worldwide by 2016. In effect, a patent is a government-sanctioned right for a short-term monopoly to exclude others for 20 years, Davit said. However, a patent is public knowledge.

He provided us with a list of what can't be patented:
  • laws of nature
  • natural phenomena
  • abstract ideas
and what can be - subject matter that is:
  • novel
  • non-obvious
  • useful
  • enabled. 
He provided us with an example of a patent:
and noted that a patent could be challenged for validity, once it is granted, and he singled out the Cisco vs. Cirrex Systems case, which Cisco won. He emphasized why validity matters - a patent not only needs to be granted but should stay granted. His research involves, in part, identifying the "drafting quality" of a patent and seeing, through text mining and statistics, whether the specifications in a patent application and the claims align.

The application that he described was for patents for cybersecurity for business data processing, a topic of great interest to me, since our supernetwork team has been doing a lot of research and publishing in cybersecurity. Even my most recent talk, which was just last Monday at the INFORMS Analytics Conference in Baltimore, was on cybersecurity. Davit defined a novel measure of  "drafting alignment" for the assessment of consistency between specifications and claims in a patent. His framework, done with a co-author at Babson, was represented in the following chart:
And, intriguingly, he identified all business processing cybersecurity patents since November 29, 2000, using a NIST keyword glossary and arrived at 2,379 such patents, and displayed a slide with those who are responsible for such patents, which include many company household names.
His approach makes use of LDA - Latent Dirichlet Allocation, based on the work of Blei et al. (2003). Each document is a probabilistic mixture of topics and he identified 300 cybersecurity topics in the patent data. He discussed text mining issues such as the preprocessing of data (the removal of Greek letters, for example), the removal of common, patent-related language, stemming, tokenization to unigrams - a vector of words and the construction of a document-term matrix. I very much appreciated his measure with credit given also to Hellinger to construct a single number for each patent document.

The lecture was outstanding and members in the audience were from the Isenberg School,  the Department of Mechanical and Industrial Engineering, as well as the Department of Civil and Environmental Engineering, among other departments at UMass Amherst. I was delighted that the announcement for his talk made the UMass Amherst homepage!
After a lot of applause, we took a group photo of some members of the audience with the speaker and then headed off to lunch.
The conversations at lunch were fabulous and ranged from updates on what is happening in the Isenberg School and UMass to GE and even Armenia, the country where Professor Khachatryan was born. And, as is our tradition, we topped off the delicious lunch at the University Club with dessert.
After, dessert, Professor Khachatryan was interviewed for the chapter's youtube channel and I will let you know when the interview gets posted.

We thank our guest speaker, Professor Davit Khachatryan, for such an illuminating and fascinating lecture! I must admit our Isenberg School of Management Management Science PhD alums are incredible educators and role models.

Saturday, November 2, 2013

A Brilliant Talk on Social Media Analytics + Sports by Dr. Les Servi of Mitre

Yesterday, at the Isenberg School of Management, we had the distinct pleasure of hosting Dr. Les Servi of MITRE, who is an INFORMS Fellow (and whom I have known since our days at Brown University as undergraduate students). Dr. Servi delivered a brilliant talk on his latest research on the topic: Analyzing Social Media Data Having Discontinuous Underlying Dynamics.

Dr. Servi's presentation was part of the UMass Amherst INFORMS Speakers Series, which the Student Chapter helps me to organize and to host.

His talk was on his paper in Operations Research Letters, just hot off the press, and published in the November issue.

The paper begins with the statement, which immediately captures your interest (as did his talk): Although physical objects follow well understood Newtonian physics and are free of discontinuous dynamics, emotional intensity dynamics evolve continuously with unknown dynamics until a tipping point or external event triggers a discontinuity. 

In his presentation, Dr. Servi asked whether anger has dynamics (the same about sadness and positive emotions). Is there a formula that can capture the anger of citizens and is there a  momentum associated with anger? He concluded that sadness (and other emotions) follow dynamics that are different from those of rockets since there are discontinuities. His paper not only presents a model for a more nuanced dynamic for emotions but also a dynamic programming  algorithm to solve the associated optimization problem that identifies times of emotional discontinuities. He then illustrated the new method for the  analysis of mood shifts reflected in 380,000 Twitter messages related to one of the world’s most popular soccer teams, Manchester United, during their 2011–12 season.  He was impressed that so many in the audience at the Isenberg School knew of this team and its sport (a finance audience at a talk he gave in Boston did not recognize the team).

And what Dr. Servi discovered through analyzing the data was fascinating and not what one would expect immediately. The figure below displays the Mood Shift Analysis of the Twitter messages showing a breakpoint on 2/6/2012 and 5/14/2012.

The discontinuities in mood associated with certain dates were not due to wins or losses of one of the world's most popular sport franchises (and one student in the audience had been to Manchester games) but one marked the anniversary of the following event: the tipping point found on February 6, 2012, might be due, according to Dr. Servi,  to it being the 54th anniversary of an airplane crash in Munich which killed 8 Manchester United players and 3 staff and injured 9 other players as well as the team manager. Among serious Manchester United fans this event and date are well known despite it happening so long ago.
 
With a great talk such as this, our minds just percolated with ideas and questions. I asked whether MITRE had applied for a patent since the possible applications from finance to politics were simply stunning and the answer was ,"Yes," --  see here.   One of my colleagues, Dr. Ryan Wright,  asked a question about acceleration, which I thought was really interesting -- for example, could the model and algorithm track herding/crowding behavior? Dr. Rod Warnick of our great Hospitality and Tourism Management Department also asked a great question about seasonality with reference to Google as did several of the students. My colleague, Dr. Senay Solak, continued the conversations.


The discussions lasted as time just flew by until close to 4 o'clock and I think the students from the Isenberg School and the College of Engineering that came as well as the faculty will never forget this talk. We thank Dr. Les Servi for the clarity and brilliance of his talk! The previous time that Dr. Servi spoke in our series was in the Fall of 2006 when he talked about tracking pirates (and that was even before such activities hit the news).

 
Special thanks also to Dr. Bruce Weinberg, the Chair of the Marketing Department at the Isenberg School, and a social media star,  and to Dr. Weibo Gong of the Department of Electrical and Computer Engineering at UMass Amherst, whose PhD advisor at Harvard University was Professor Larry Ho (also Servi's advisor), who joined Dr. Servi and me for lunch at the University Club.

After lunch, Dr. Servi and many others joined us in a celebration of the  3 awards that we received at the INFORMS conference in Minneapolis. The cake was delicious and the company simply wonderful with even Dr. Amir Masoumi joining us from Manhattan College.
 
What a great time to be an Operations Researcher living in an era with a proliferation of data. What information will the data reveal and what new discoveries?! And as Dr. Les Servi said, Philip Morse, a pioneer of Operations Research, would be very pleased.
 

Wednesday, May 23, 2012

So Cool to Have Our NSF-Sponsored Research Cited in Granted Patents

Published research and scholarship can be recognized in different ways -- through subsequent citations, the awards and recognitions that may follow, through applications and use in the real world, and through the inspiration of innovations as exemplified through patents.

I have never personally applied for a patent but, had I stayed in industry, I am sure that, by now, I would have.

However, today, while actually digging further into the background on a very provocative article, "Troves of Personal Data, Forbidden to Researchers," by John Markoff  in yesterday's New York Times, in which names of several colleagues that I know quite well:, Bernardo Huberman of HP, Barabasi of Northeastern, Hal Varian, now of Google, and Alex Pentland of MIT's Media Lab, I came upon some recently granted patents.

The inventor of these patents is Dr. Daniel Palestrant. He is an MD so I defer to him and call him Dr. and he is also an entrepreneur as the founder of Sermo and Par80. The three patents that he has been granted cite two papers that I co-authored (all with females) on an earlier National Science Foundation grant: Decentralized  Decision Making in Complex Network Systems. My Co-PIs on this grant were June Dong and Pat Mokhtarian. The grant also supported the research of my then doctoral student, Tina Wakolbinger.

Our papers that are cited in the 3 patents are:


Multicriteria network equilibrium modeling with variable weights for decision-making in the Information Age with applications to telecommuting and teleshopping (with J. Dong and P. L. Mokhtarian) (2002), Journal of Economic Dynamics and Control, 26, 1629-1650 

and

Dynamic supernetworks for the integration of social networks and supply chains with electronic commerce: Modeling and analysis of buyer-seller relationships with computations (with T. Wakolbinger) (2004), Netnomics, 6, 153-185.

And, Dr. Palestrant also cites the work of Varian and Barabasi in these patents, as well as several others who have contributed to network science!