Language Selection

English French German Italian Portuguese Spanish

Big Brother gets Bigger

Filed under
Security

The National Security Agency is teasing intelligence information out of massive federal databases via a program that uses innovative methods to discover hidden results and improve analyst performance.

The Glass Box program has been using unclassified, open-source information for three years to produce information used by the Novel Intelligence from Massive Data program, according to contractor Battelle Memorial Institute of Columbus, Ohio.

NSA recently awarded Battelle a $1.507-million contract to continue its Glass Box work from last January through June 2006. The agency had sought sources for Glass Box work in September 2004, according to Federal Sources Inc., a consulting firm that tracks IT contracts.

According to FSI, the government did not receive any responses to its sources-sought notice and decided last November to negotiate with a list of previously identified potential contractors. Eventually, only Battelle submitted a proposal. The vendor and the government then negotiated an agreement.

According to contract documents, Glass Box is designed partly to evaluate intelligence algorithms developed by other, presumably classified, NIMD activities.

The program also is intended to develop the Glass Box Analytic Environment, a hub task of the NIMD project. The contract documents describe NIMD as a research and development project intended to last for several years to discover the "novel intelligence" that lurks undetected in the intelligence community's databases.

Novel intelligence falls in the category of information that causes intelligence analysts to gain new understanding of previously unappreciated or misunderstood threats, according to the contract documents.

"This information may emerge from discoveries in the content and patterning of new data, or discoveries resulting from 'out-of-the-box' analytical reinterpretations of existing data," according to the government. "Novel intelligence often equates to 'suspicious revelations' in one-time or first-time events, or in hidden connections between seemingly independent events or entities, or in puzzle pieces collected long ago but that suddenly make sense in light of recent observations."

Battelle responded to an e-mail inquiry by stating that analysts working on the Glass Box experiment have processed more than 70 intelligence analysis tasks and produced more than 80 reports. "More than 48 gigabytes of data are now contained in the Glass Box database and file store," Battelle said.

"From examining the Glass Box data, researchers have created visualizations of the analytic process, identified inefficiencies in the current analytic work environment, improved search techniques, created user models that help tools understand and predict analyst behaviors, and more," according to the research institute.

Source.

More in Tux Machines

Join me in supporting The Ada Initiative

When I first read that Linux kernel developer Valerie Aurora would be changing careers to work full-time on behalf of women in open source communities, I never imagined it would lead so far so fast. Today, The Ada Initiative is a non-profit organization with global reach, whose programs have helped create positive change for women in a wide range of communities beyond open source. Building on this foundation, imagine how much more they can do in the next four years! That’s why I’m pledging my continuing support, and asking you to join me. Read more

Cantor: new features in KDE 4.14

KDE 4.14 was released in August 2014 but I did not have time to write about new features in Cantor for that release. So, let’s fix it now! New backend: Lua Read more

Udine city struggles to remove IT vendor lock-in

The Italian city of Udine is 'gradually and painfully' removing all the ties that bind the city's ICT systems to the usual proprietary operating systems and office productivity solutions, reports head of the IT department, Antonio Scaramuzzi. The city aims to slowly introduce more free and open source software alternatives. Unhurried, the municipality is implementing open source technologies where feasible, avoiding big migration projects, Scaramuzzi writes to the Open Source Observatory and Repository (OSOR). Earlier this month, IT trade news site Zdnet that the town is making Apache OpenOffice the default office suite. The software is already installed on all of the city's 900 PCs. ZDNet writes that this switch will save the city about 400 euro per PC in proprietary software licences. Read more

The Path to Full-time Open Source

Three months ago I quit my job to work on Sidekiq and build a brand new OSS project and commercial product. Tomorrow I want to introduce it to you. Read more