Language Selection

English French German Italian Portuguese Spanish

Big Brother gets Bigger

Filed under
Security

The National Security Agency is teasing intelligence information out of massive federal databases via a program that uses innovative methods to discover hidden results and improve analyst performance.

The Glass Box program has been using unclassified, open-source information for three years to produce information used by the Novel Intelligence from Massive Data program, according to contractor Battelle Memorial Institute of Columbus, Ohio.

NSA recently awarded Battelle a $1.507-million contract to continue its Glass Box work from last January through June 2006. The agency had sought sources for Glass Box work in September 2004, according to Federal Sources Inc., a consulting firm that tracks IT contracts.

According to FSI, the government did not receive any responses to its sources-sought notice and decided last November to negotiate with a list of previously identified potential contractors. Eventually, only Battelle submitted a proposal. The vendor and the government then negotiated an agreement.

According to contract documents, Glass Box is designed partly to evaluate intelligence algorithms developed by other, presumably classified, NIMD activities.

The program also is intended to develop the Glass Box Analytic Environment, a hub task of the NIMD project. The contract documents describe NIMD as a research and development project intended to last for several years to discover the "novel intelligence" that lurks undetected in the intelligence community's databases.

Novel intelligence falls in the category of information that causes intelligence analysts to gain new understanding of previously unappreciated or misunderstood threats, according to the contract documents.

"This information may emerge from discoveries in the content and patterning of new data, or discoveries resulting from 'out-of-the-box' analytical reinterpretations of existing data," according to the government. "Novel intelligence often equates to 'suspicious revelations' in one-time or first-time events, or in hidden connections between seemingly independent events or entities, or in puzzle pieces collected long ago but that suddenly make sense in light of recent observations."

Battelle responded to an e-mail inquiry by stating that analysts working on the Glass Box experiment have processed more than 70 intelligence analysis tasks and produced more than 80 reports. "More than 48 gigabytes of data are now contained in the Glass Box database and file store," Battelle said.

"From examining the Glass Box data, researchers have created visualizations of the analytic process, identified inefficiencies in the current analytic work environment, improved search techniques, created user models that help tools understand and predict analyst behaviors, and more," according to the research institute.

Source.

More in Tux Machines

Linux 4.9-rc8

So if anybody has been following the git tree, it should come as no surprise that I ended up doing an rc8 after all: things haven't been bad, but it also hasn't been the complete quiet that would have made me go "no point in doing another week". Extra kudos to Arnd, who actually root-caused the incredibly annoying "modversions do not work with new versions of binutils", bisecting it to a particular change to symbol handling in binutils, and then adding a small one-liner patch to the kernel to work around the issue. We already had other workarounds in place, but it's always good to know exactly what in the tool chain changed to cause things like this. Read more Also: Linux Kernel 4.9 Slated for December 11 Release as Linus Torvalds Outs RC8 Linux 4.9-rc8 Kernel Released