DHS S&T Forensic Video Exploitation & Analysis Tool Competes in ‘ASTORS’

The Department of Homeland Security (DHS) Science and Technology Directorate (S&T) helps the nation prepare for and respond to critical incidents, such as active shooters and terrorist attacks, by improving capabilities during all stages of response. The Forensic Video Exploitation and Analysis (FOVEA) tool helps first responders quickly analyze video to identify potential suspects by allowing users to tag a person to a left-behind item and reconstruct that individual’s path across multiple camera views.
The Department of Homeland Security (DHS) Science and Technology Directorate (S&T) helps the nation prepare for and respond to critical incidents, such as active shooters and terrorist attacks, by improving capabilities during all stages of response. The Forensic Video Exploitation and Analysis (FOVEA) tool helps first responders quickly analyze video to identify potential suspects by allowing users to tag a person to a left-behind item and reconstruct that individual’s path across multiple camera views.

An action movie opens to a scene on the metro platform where a bag has been left unattended, raising suspicion in the metro’s security control room.

Video cameras zero in and, through movie magic, security personnel track the footage backward to identify who left the bag.

Now, they can track the suspect’s movements to catch the culprit and save the day.

It’s actually not movie magic that facilitates saving the day; it is a technologically advanced reality being demonstrated right now thanks to tools in development by the Department of Homeland Security (DHS) Science and Technology Directorate (S&T).

The FOVEA (Forensic Video Exploitation and Analysis) Tool Suite is an add-on suite of analytic tools for the forensic review of video in large-scale surveillance systems, developed by MIT Lincoln Laboratory under the Department of Homeland Security (DHS) Science and Technology (S&T) Directorate Office of Mission and Capability Support (MCS) Surface Transportation Explosive Threat Detection (STETD) Program.

The Forensic Video Exploitation and Analysis (FOVEA) tool was developed to speed up the process of reviewing and analyzing security footage in the aftermath of an attack or during an event of interest. (Courtesy of MIT Lincoln Laboratory)
The Forensic Video Exploitation and Analysis (FOVEA) tool was developed to speed up the process of reviewing and analyzing security footage in the aftermath of an attack or during an event of interest. (Courtesy of MIT Lincoln Laboratory)

While significant investment has been made toward improving camera coverage and quality, the burden on video operators for reviewing and extracting useful information from the video has only increased.

Daily investigation tasks (such as searching through video, investigating abandoned objects, or piecing together information from multiple cameras) still require a significant amount of manual review by video operators.

In contrast to other tools which require exporting video data or otherwise curating the video collection before analysis, FOVEA is designed to integrate with existing surveillance systems.

Tools can be applied to any video stream in an “on-demand” fashion without additional hardware.

Efficient forensic review is a major capability gap in existing commercial video management systems.

Speeding up this process makes security operators more efficient, and also reduces reaction time in the case of in-progress events.

This effort aims to address this gap through the development and evaluation of prototype video analytics, which have been combined into a tool suite named FOVEA (Forensic Video Exploitation and Analysis).

(See how a video algorithm that detects bags left behind and cutting-edge video forensic tools are some of the technologies featured in “Securing Surface Transportation,” and can go along way in securing train stations and protecting the traveling public. Courtesy of the DHS Science and Technology Directorate and YouTube.)

“The Video Forensic Tools monitor for potential threat indicators as well as criminal or other suspicious behaviors,” explains Program Manager Don Roberts.

DHS S&T Develops DIY Method to Decontaminate N95 Masks (Video) - American Security Today
DHS S&T Program Manager Don Roberts Accepting a 2019 ‘ASTORS’ Award at ISC East.

“There are three distinct tools in the suite, each facilitating a unique analysis.”

“The tools are flexible and can be used on many scene types and for unpredictable investigation tasks.”

FOVEA Capabilities Include:

Video Summarization:

  • The FOVEA (Forensic Video Exploitation and Analysis) Tool condenses all motion activity within video into a very short visual summary.

  • The summary also acts as an interactive (clickable) index into the original video sequence.

Jump Back:

  • The FOVEA (Forensic Video Exploitation and Analysis) Tool automatically seeks to the portion of video when an abandoned object first appeared, so that the operator can immediately understand the circumstances surrounding the abandonment.

Multi-Camera Navigation and Path Reconstruction:

  • The FOVEA (Forensic Video Exploitation and Analysis) Tool assists an operator in tracking a person-of-interest across multiple camera views.

  • The operator can annotate video, seamlessly traverse between camera views, and reconstruct an evidential video by automatically combining snippets from many cameras.

Key benefits of FOVEA Include:

The Forensic Video Exploitation and Analysis interface enables security personnel to highlight a person of interest and then reconstruct the path of that individual across multiple camera views.
The Forensic Video Exploitation and Analysis interface enables security personnel to highlight a person of interest and then reconstruct the path of that individual across multiple camera views. (Courtesy of MIT Lincoln Laboratory)
  • Novel analytic capabilities to accelerate video review for many forensic investigation tasks

  • Extremely efficient algorithm implementations that do not require new or specialized hardware (e.g., GPUs or large servers)

  • Implementation of tools as a lightweight add-on that is directly integrated with existing video surveillance systems, therefore not requiring export or download of video before analysis

FOVEA has been pilot-tested at several Mass Transit Security Operations Centers to gather feedback from end users.

Anecdotal evidence has shown usefulness for many common tasks, as well as creative uses that were not envisioned by the developers.

Users have confirmed that tasks are accomplished faster with FOVEA than if manually searching and reviewing the video.

Complex investigations that typically require many hours (or multiple investigators) were accomplished in minutes or tens of minutes.

In several cases, use of FOVEA led to more complete discovery of events in video by highlighting information that was previously missed via manual review.

All video data is retained by the operational surface transportation law enforcement agencies in keeping with the subject agencies’ respective legal, privacy, and civil liberties policies and procedures.

DHS S&T FOVEA Tool Nominated to Compete in the 2021 ‘ASTORS’ Awards Program

American Security Today’s ‘ASTORS’ Homeland Security Awards program is today in its Sixth Year and continues to recognize the Outstanding Innovations of top firms and agencies in the Homeland Security and Public Safety fields.

The Annual ‘ASTORS’ Awards is the preeminent U.S. Homeland Security Awards Program highlighting the most cutting-edge and forward-thinking security solutions coming onto the market today, to ensure our readers have the information they need to stay ahead of the competition, and keep our Nation safe – one facility, street, and city at a time.

Transportation Security Administration (TSA) Administer, David Pekoske
David Pekoske, Transportation Security Administration (TSA) Administer

American Security Today is pleased to announce TSA Administrator  David Pekoske, will join the organization as a featured speaker at the 2021 ‘ASTORS’ Homeland Security Awards Presentation Luncheon, on November 18, 2021 at ISC East in New York City.

“On the heels of an unprecedented global pandemic, continued unrest in our cities and potentially catastrophic cyberattacks on our nations critical infrastructure, the focus of the 2021 ‘ASTORS’ Awards Luncheon will be on the latest, state-of-the-art innovations that are driving investments in new public security and safety technologies and systems,” said AST Editorial and Managing Director Tammy Waitt.

“As a recognized expert in crisis management, strategic planning, innovation and aviation, surface transportation and maritime security, David Pekoske’s message highlighting his top priorities and challenges for the TSA based on his years of wide-ranging experience will be critical to our attendees internalizing the critical nature of these escalating challenges, and realizing innovative new approaches to meet them.”

The 2021 ‘ASTORS’ Awards Program is Proudly Sponsored by AMAROK and SIMS Software, along with Returning Premier Sponsors
ATI SystemsAttivo NetworksAutomatic Systems, and Reed Exhibitions.

Nominations are currently being accepted for the 2021 ‘ASTORS’ Homeland Security Awards at https://americansecuritytoday.com/ast-awards/.

Comprehensive List of Categories Include:

Access Control/ Identification Personal/Protective Equipment Law Enforcement Counter Terrorism
Perimeter Barrier/ Deterrent System Interagency Interdiction Operation Cloud Computing/Storage Solution
Facial/IRIS Recognition Body Worn Video Product Cyber Security
Video Surveillance/VMS Mobile Technology Anti-Malware
Audio Analytics Disaster Preparedness ID Management
Thermal/Infrared Camera Mass Notification System Fire & Safety
Metal/Weapon Detection Rescue Operations Critical Infrastructure
License Plate Recognition Detection Products And Many Others!
COVID Innovations And Many Others!

 

Don’t see a Direct Hit for your Product, Agency or Organization?

The World Health Organization (WHO) declared the 2019–20 coronavirus outbreak a Public Health Emergency of International Concern (PHEIC) on 30 January 2020 and a pandemic on 11 March 2020. Local transmission of the disease has occurred across all fifty states in the America.

With the unprecedented occurrence of the COVID-19 pandemic, the focus of the safety and security industries has realized the need to increase innovations to address the daily growing challenges.

As such AST aims to make sure these firms and professionals are reflected in the 2021 ‘ASTORS’ Awards Program, so we’d like to encourage you to submit appropriate categories recommendations and include COVID-19 Frontline Professionals in your Nominations to see that these Professionals, Facilities, and Vendors receive the Recognition they Deserve!

Submit your category recommendation for consideration to Michael Madsen, AST Publisher at: mmadsen@americansecuritytoday.com.

Register for the 2021 ‘ASTORS’ Luncheon Today

2019 'ASTORS' Awards Program Banquet Luncheon
2019 ‘ASTORS’ Awards Program Banquet Luncheon

At ISC East 2021 you with the opportunity to interact with a broad array of security industry professionals.

ISC East works closely with other businesses in the security and public safety space to help bring together the Northeast’s largest security trade show each year.

In collaboration with premier sponsor SIA (Security Industry Association) and in partnership with ASIS NYC, ISC East is proud to work with and be supported by various associations, trade publications, charities, and more.

Therefore, the ISC audience of security dealers, installers, integrators, consultants, corporate, government and law enforcement/first responder practitioners will be joined by the ASIS NYC audience of major corporate managerial-through-director-level national and global security executives.

The combination of one-on-one conversations with the industry’s top innovators,  integrators and security executives, special events, high-quality education and training, and strong support from industry associations, will allow attendees to learn and evaluate solutions from leading security exhibitors and brands. 

The 2019 ‘ASTORS’ Awards Program surpassed expectations with a record number of nominations received from industry leaders and government agencies, and drew over 200 attendees to the ‘ASTORS’ Awards Presentation Banquet – an exclusive gourmet luncheon and networking opportunity which filled to capacity, before having to turn away late registrants.

Your ‘ASTORS’ Awards Luncheon registration includes complimentary attendee access to ISC East – Thank take advantage of this exclusive luncheon opportunity to take a break from the show – Invite your team, guests, clients and show visitors to a lovely and affordable plated meal event in the heart of New York City, for  a fabulous networking opportunity!

Go to https://americansecuritytoday.com/product/awards-luncheon/ to secure your seat or reserve a table.

***Limited space available so Register Today. There will be no on-site registrations.

Why American Security Today?

The traditional security marketplace has long been covered by a host of publications putting forward the old school basics to what is Today – a fast changing security landscape.

The traditional security marketplace has long been covered by a host of publications putting forward the old school basics to what is Today – a fast changing security landscape.

American Security Today is uniquely focused on the broader Homeland Security & Public Safety marketplace with over 75,000 readers at the Federal, State and local levels of government as well as firms allied to government.

American Security Today brings forward a fresh compelling look and read with our customized digital publications that hold readers eyes throughout the story with cutting edge editorial that provides solutions to their challenges.

Harness the Power of the Web – with our 100% Mobile Friendly Publications

AST puts forward the Largest and Most Qualified Circulation in Government with Over 75,000 readers on the Federal, State and Local levels.
AST puts forward the Largest and Most Qualified Circulation in Government with Over 75,000 readers on the Federal, State and Local levels.

The AST Digital Publications is distributed to over 75,000 qualified government and homeland security professionals in federal, state and local levels.

‘PROTECTING OUR NATION, ONE CITY AT A TIME’

AST Reaches both Private & Public Experts, essential to meeting these new challenges.

Today’s new generation of public safety and security experts need real-time knowledge to deal with domestic and international terrorism, lone wolf attacks, unprecedented urban violence, shifts in society, culture and media bias – making it increasingly difficult for Homeland Security, Law Enforcement, First Responders, Military and Private Security Professionals to implement coordinated security measures to ensure national security and improve public safety.

American Security Today

These experts are from Government at the federal, state and local level as well as from private firms allied to government.

AST provides a full plate of topics in our AST Monthly Magazine Editions, AST Website and AST Daily News Alerts, covering 23 Vital Sectors such as Access Control, Perimeter Protection, Video Surveillance/Analytics, Airport Security, Border Security, CBRNE Detection, Border Security, Ports, Cybersecurity, Networking Security, Encryption, Law Enforcement, First Responders, Campus Security, Security Services, Corporate Facilities, and Emergency Response among others.

AST has Expanded readership into integral Critical Infrastructure audiences such as Protection of Nuclear Facilities, Water Plants & Dams, Bridges & Tunnels, and other potential targets of terrorism.

Other areas of concern include Transportation Hubs, Public Assemblies, Government Facilities, Sporting & Concert Stadiums, our Nation’s Schools & Universities, and Commercial Business Destinations – all enticing targets due to the large number of persons and resources clustered together.

To learn more about the 2020 ‘ASTORS’ Homeland Security Award Winners solutions, Check Out the New 2020 ‘ASTORS’ CHAMPIONS Edition Fully Interactive Magazine – the Best Products of 2020 ‘A Year in Review’.

The Annual CHAMPIONS edition includes a review of the ‘ASTORS’ Award Winning products and programs, highlighting key details on many of the winning firms products and services, includes video interviews and more.

It is your Go-To source throughout the year for ‘The Best of 2020 Products and Services‘ endorsed by American Security Today, and can satisfy your agency’s and organization’s most pressing Homeland Security and Public Safety needs.

From Physical Security (Access Control, Critical Infrastructure, Perimeter Protection and Video Surveillance Cameras and Video Management Systems), to IT Security (Cybersecurity, Encryption, Data Storage, Anti-Malware and Networking Security – Just to name a few), the 2020 ‘ASTORS’ CHAMPIONS EDITION has what you need to Detect, Delay, Respond to, and Mitigate today’s real-time threats in our constantly evolving security landscape.

It also includes featured guest editorial pieces from some of the security industry’s most respected leaders, and recognized firms in the 2020 ‘ASTORS’ Awards Program.

  • For a complete list of 2020 ‘ASTORS’ Award Winners, click here.

For more information on All Things American Security Today, and the 2021 ‘ASTORS’ Awards Program, please contact Michael Madsen, AST Publisher at mmadsen@americansecuritytoday.com.

AST strives to meet a 3 STAR trustworthiness rating, based on the following criteria:

  • Provides named sources
  • Reported by more than one notable outlet
  • Includes supporting video, direct statements, or photos

Subscribe to the AST Daily News Alert Here.