Securing big data provenance for auditors

The big data provenance black box as reliable evidence

Research output: Contribution to journalArticleResearchpeer-review

5 Citations (Scopus)

Abstract

The purpose of this article is to highlight a main issue regarding reliable audit evidence derived from Big Data—that of secure data provenance. Traditionally, audit evidence external to the client has been regarded as superior to other forms of evidence. However, regarding external “messy” Big Data sources that may be material to aspects of the audit, these sources may lack provenance and verifiability. That is, the origins of the data may be unclear and its log files incomplete. According to the standards, such evidence should be considered as less reliable for audit evidence. External auditors, as outsiders of the client, should be able to reproduce the data lifecycle or transaction path, which may not be possible in an electronic environment with incomplete provenance. Furthermore, this mapping or provenance of the data origins and history should be securely maintained so that it cannot be thwarted. This need for secure data provenance has been largely ignored by the business community in its haste to utilize Big Data, but has been acknowledged by extant systems research as being an area that requires attention. This paper contributes to the discussion of Big Data provenance through the lens of public company auditing, where the provenance and reliability of data sources and audit evidence are of paramount importance. This paper also proposes a system of secure provenance collection, the Big Data Provenance Black Box, which is derived from several streams of extant research.

Original languageEnglish
Pages (from-to)17-36
Number of pages20
JournalJournal of Emerging Technologies in Accounting
Volume13
Issue number1
DOIs
StatePublished - 1 Mar 2016

Fingerprint

Lenses
Industry
Big data
Auditors
Black box
Audit evidence
Data sources
Outsider
Life cycle
External auditor
Audit
Verifiability
Auditing
Systems research

Keywords

  • Audit evidence
  • Auditing
  • Big data
  • Data provenance
  • Hadoop/MapReduce

Cite this

@article{5959b348679f42bc9baadb9535dc67c3,
title = "Securing big data provenance for auditors: The big data provenance black box as reliable evidence",
abstract = "The purpose of this article is to highlight a main issue regarding reliable audit evidence derived from Big Data—that of secure data provenance. Traditionally, audit evidence external to the client has been regarded as superior to other forms of evidence. However, regarding external “messy” Big Data sources that may be material to aspects of the audit, these sources may lack provenance and verifiability. That is, the origins of the data may be unclear and its log files incomplete. According to the standards, such evidence should be considered as less reliable for audit evidence. External auditors, as outsiders of the client, should be able to reproduce the data lifecycle or transaction path, which may not be possible in an electronic environment with incomplete provenance. Furthermore, this mapping or provenance of the data origins and history should be securely maintained so that it cannot be thwarted. This need for secure data provenance has been largely ignored by the business community in its haste to utilize Big Data, but has been acknowledged by extant systems research as being an area that requires attention. This paper contributes to the discussion of Big Data provenance through the lens of public company auditing, where the provenance and reliability of data sources and audit evidence are of paramount importance. This paper also proposes a system of secure provenance collection, the Big Data Provenance Black Box, which is derived from several streams of extant research.",
keywords = "Audit evidence, Auditing, Big data, Data provenance, Hadoop/MapReduce",
author = "Deniz Appelbaum",
year = "2016",
month = "3",
day = "1",
doi = "10.2308/jeta-51473",
language = "English",
volume = "13",
pages = "17--36",
journal = "Journal of Emerging Technologies in Accounting",
issn = "1554-1908",
publisher = "American Accounting Association",
number = "1",

}

Securing big data provenance for auditors : The big data provenance black box as reliable evidence. / Appelbaum, Deniz.

In: Journal of Emerging Technologies in Accounting, Vol. 13, No. 1, 01.03.2016, p. 17-36.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Securing big data provenance for auditors

T2 - The big data provenance black box as reliable evidence

AU - Appelbaum, Deniz

PY - 2016/3/1

Y1 - 2016/3/1

N2 - The purpose of this article is to highlight a main issue regarding reliable audit evidence derived from Big Data—that of secure data provenance. Traditionally, audit evidence external to the client has been regarded as superior to other forms of evidence. However, regarding external “messy” Big Data sources that may be material to aspects of the audit, these sources may lack provenance and verifiability. That is, the origins of the data may be unclear and its log files incomplete. According to the standards, such evidence should be considered as less reliable for audit evidence. External auditors, as outsiders of the client, should be able to reproduce the data lifecycle or transaction path, which may not be possible in an electronic environment with incomplete provenance. Furthermore, this mapping or provenance of the data origins and history should be securely maintained so that it cannot be thwarted. This need for secure data provenance has been largely ignored by the business community in its haste to utilize Big Data, but has been acknowledged by extant systems research as being an area that requires attention. This paper contributes to the discussion of Big Data provenance through the lens of public company auditing, where the provenance and reliability of data sources and audit evidence are of paramount importance. This paper also proposes a system of secure provenance collection, the Big Data Provenance Black Box, which is derived from several streams of extant research.

AB - The purpose of this article is to highlight a main issue regarding reliable audit evidence derived from Big Data—that of secure data provenance. Traditionally, audit evidence external to the client has been regarded as superior to other forms of evidence. However, regarding external “messy” Big Data sources that may be material to aspects of the audit, these sources may lack provenance and verifiability. That is, the origins of the data may be unclear and its log files incomplete. According to the standards, such evidence should be considered as less reliable for audit evidence. External auditors, as outsiders of the client, should be able to reproduce the data lifecycle or transaction path, which may not be possible in an electronic environment with incomplete provenance. Furthermore, this mapping or provenance of the data origins and history should be securely maintained so that it cannot be thwarted. This need for secure data provenance has been largely ignored by the business community in its haste to utilize Big Data, but has been acknowledged by extant systems research as being an area that requires attention. This paper contributes to the discussion of Big Data provenance through the lens of public company auditing, where the provenance and reliability of data sources and audit evidence are of paramount importance. This paper also proposes a system of secure provenance collection, the Big Data Provenance Black Box, which is derived from several streams of extant research.

KW - Audit evidence

KW - Auditing

KW - Big data

KW - Data provenance

KW - Hadoop/MapReduce

UR - http://www.scopus.com/inward/record.url?scp=85006700471&partnerID=8YFLogxK

U2 - 10.2308/jeta-51473

DO - 10.2308/jeta-51473

M3 - Article

VL - 13

SP - 17

EP - 36

JO - Journal of Emerging Technologies in Accounting

JF - Journal of Emerging Technologies in Accounting

SN - 1554-1908

IS - 1

ER -