Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

A Perl-Based Framework For Distributed Processing

Published

Author(s)

Douglas R. White, John M. Tebbutt

Abstract

The National Software Reference Library (NSRL) of the U.S. National Institute of Standards and Technology (NIST) collects software from various sources and publishes file profiles computed from this software (such as MD5 and SHA-1 hashes) as a Reference Data Set (RDS) of information. The RDS can be used in the forensic examination of file systems, for example, to speed the process of identifying unknown or suspicious files. This paper describes the cross-platform, public domain, Linux/Apache/MySQL/Perl (LAMP) framework with which we produce the RDS from acquired software. The framework is easily deployed (it has been packaged on a Knoppix-based live CD) and allows for the distributed processing of large numbers of files in a loose, heterogeneous computing cluster. We go on to suggest that the framework is sufficiently general in its implementation to be suitable for application to classes of problems quite beyond our original scope.
Proceedings Title
Open Source Developers' Conference 2001
Conference Dates
December 1-3, 2004
Conference Location
Melbourne, AS

Keywords

computer forensics, distributed processing, file signature, large data collection, NSRL

Citation

White, D. and Tebbutt, J. (2004), A Perl-Based Framework For Distributed Processing, Open Source Developers' Conference 2001, Melbourne, AS (Accessed October 31, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created December 1, 2004, Updated February 17, 2017