⇒ #digitalethics2024, #keyConcepts

function creep

Definition of function creep

Simply put, function creep is the expansion of a system or technology beyond its original purposes. Decomposing both terms in the concept, the definition of function is the appropriate use of X in relation to its intended purpose. For instance, the function of a hammer is to hit nails. A hammer may be used to crush someone's skull but one may argue that it is not its intended or proper use. The term creep adds the notion of gradualness but also stealth and uncanniness, which result in the often negative connotation of function creep. Function creep is often mentioned in the context of Surveillance Studies, when data processing systems' purposes are expanded in a way that would not have been accepted when the technology/system was first launched. Koops (2021) formally defines function creep as "an imperceptibly transformative and therewith contestable change in a data-processing system's proper activity."

Distinctions from other closely related concepts:

1. The concept of reverse adaptation (Winner, 1977) refers to the adjustment of human ends to match the character of the available means. With the integration of new technologies, such as AI, this means that people will shape their ends or behavior to fit the technologies' affordances. Reverse adaptation is closely related to function creep as it can be at the root of function expansion/creep (Koops, 2021).

2. The concept of unintended findings/consequences of technology (e.g., AI) refers to outcomes of a purposeful action that were not intended or unforeseen. Unintended consequences are related to function creep because when function creep occurs it is likely accompanied by unintended consequences, specifically in terms of ethical issues (Dahl, 2009). For instance, in the UK and Norway the expansion of DNA database purposes in the name of increased security led to unintended consequences such as challenging the presumption of innocence and confronting citizen with previously unknown family ties (Dahl, 2009).

Implications of commitment to (diminishing) function creep

The issue of function creep is that it comes with the question: who determines a system’s ‘proper’ activity or 'intended' function and who determines appropriate added functions?
If one wants to commit to diminishing function creep (with harmful consequences), one commits themselves to transparency and public deliberation whenever a new transformative function is proposed. The expanded function proposal needs to be made visible and subject to evaluation, ideally by an independent party and democratic deliberation. Moreover, one commits themselves to deploy the same quality of risk assessment to new functions as the intial development of the system to avoid serious unintended harms.

Societal transformations required for addressing concern raised by function creep

A societal and cultural change necessary for addressing the concern raised by function creep is increased active involvement in deliberating the purposes and appropriate use of technologies, such as AI, in society. Moreover, organisations incentives would need to change. Currently monetary and efficiency incentives often favour function creep and override other important ethical questions and concerns. Moreover, transparency and documentation of new function proposals would have to become the norm/law to allow evaluation and accountability. Finally, it is expected that functions of a technology may change over time, however there is a risk with function creep that people may become accustomed to unethical or initially undesired changes because they happen gradually. Therefore, society should be aware of the role of gradual cultural adaptation when deliberating new functions of technologies.

References

Koops, B. J. (2021). The concept of function creep. Law, Innovation and Technology, 13(1), 29-56.
Dahl, J. Y., & Sætnan, A. R. (2009). “It all happened so slowly”–On controlling function creep in forensic DNA databases. International journal of law, crime and justice, 37(3), 83-103.
Winner, L. (1977). Autonomous technology: Technics-out-of-control as a theme in political thought. Mit Press.