Building the Invisible Palace: Capability gaps, traps and overlaps in complex software projects

Steve Flowers

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBNResearchpeer-review

Abstract

The growth of the IT industry has been dramatic and information and communication technologies (ICTs) now play a fundamental part in many, if not all, of the critical infrastructures upon which modern society depends. The use of ICTs within organisations of all types is approaching ubiquity with many such systems being viewed as mission critical. This spread and the increasing criticality of such systems itself relies upon the ability to develop complex software systems in a reliable and predictable fashion. However, there is widespread evidence that the development of software in such a fashion continues to present a formidable challenge to many organisations with software typically being delivered late, over budget and with reduced functionality. Whilst large software projects have always posed huge challenges for suppliers of bespoke software, the nature and scale of that challenge has evolved over the years. At the level of the individual firm, modern information systems development takes place in the context of a series of interconnected complexities concerning alignment with organisational goals, primary and secondary sourcing, integration of new systems and backward integration with existing systems. At the level of the industry, these complexities are in turn managed in the context in which specialist capability has largely migrated to the IT services industry, necessitating the involvement of a range of intermediaries. Such work takes place within the wider context of a range of highly flexible technologies with high rates of technical and skill obsolescence. Within this turbulent situation data across a range of performance metrics may be difficult or impossible to obtain with the result that organisations will often operate in the absence of reliable information. This exploratory paper will provide a high-level examination of the major challenges associated with the development of large-scale complex software systems and trace the emergence of the current situation facing many organisations. In order to provide a context for the discussion, the paper will examine the recent growth and development of the software and computer services industry and draw on earlier work that assesses its maturity (Flowers and Brady, 2001). The development of complex sourcing for IT (Venkatraman, 1997) and the rapid growth and expanding role of intermediaries within the software industry will also be examined. The nature and implications of the migration of specialist capability within the IT and software industry will be explored and the paper will build on earlier work in the area (Feeny and Willcocks, 1998) to argue that there has been the emergence of a series of capability gaps, traps and overlaps that provide a further layer of sourcing complexity to what is already a hugely complex procurement and development context. The issues and implications of this situation will be examined and it will be argued that the emergence of significant capability imbalances against the background of poor data provide the context for the continued uneven performance of complex software projects. The paper will conclude with an examination of the implications of this situation to the development of complex software projects.
Original languageEnglish
Title of host publicationEURAM 2002
Publication statusPublished - 2002
EventEURAM 2002 - Stockholm, Sweden
Duration: 1 Jan 2002 → …

Conference

ConferenceEURAM 2002
Period1/01/02 → …

Fingerprint

Software
Trap
Sourcing
Systems software
Information and communication technology
Intermediaries
Software industry
Service industries
IT industry
Imbalance
Performance metrics
Modernity
Information systems development
Nature
Obsolescence
Functionality
IT services
Alignment
Suppliers
Procurement

Keywords

  • Complex Product Systems (CoPS)
  • Computer software
  • CENTRIM

Cite this

@inproceedings{61b87aa8bf5648b784bf7cdf7e1fbeb5,
title = "Building the Invisible Palace: Capability gaps, traps and overlaps in complex software projects",
abstract = "The growth of the IT industry has been dramatic and information and communication technologies (ICTs) now play a fundamental part in many, if not all, of the critical infrastructures upon which modern society depends. The use of ICTs within organisations of all types is approaching ubiquity with many such systems being viewed as mission critical. This spread and the increasing criticality of such systems itself relies upon the ability to develop complex software systems in a reliable and predictable fashion. However, there is widespread evidence that the development of software in such a fashion continues to present a formidable challenge to many organisations with software typically being delivered late, over budget and with reduced functionality. Whilst large software projects have always posed huge challenges for suppliers of bespoke software, the nature and scale of that challenge has evolved over the years. At the level of the individual firm, modern information systems development takes place in the context of a series of interconnected complexities concerning alignment with organisational goals, primary and secondary sourcing, integration of new systems and backward integration with existing systems. At the level of the industry, these complexities are in turn managed in the context in which specialist capability has largely migrated to the IT services industry, necessitating the involvement of a range of intermediaries. Such work takes place within the wider context of a range of highly flexible technologies with high rates of technical and skill obsolescence. Within this turbulent situation data across a range of performance metrics may be difficult or impossible to obtain with the result that organisations will often operate in the absence of reliable information. This exploratory paper will provide a high-level examination of the major challenges associated with the development of large-scale complex software systems and trace the emergence of the current situation facing many organisations. In order to provide a context for the discussion, the paper will examine the recent growth and development of the software and computer services industry and draw on earlier work that assesses its maturity (Flowers and Brady, 2001). The development of complex sourcing for IT (Venkatraman, 1997) and the rapid growth and expanding role of intermediaries within the software industry will also be examined. The nature and implications of the migration of specialist capability within the IT and software industry will be explored and the paper will build on earlier work in the area (Feeny and Willcocks, 1998) to argue that there has been the emergence of a series of capability gaps, traps and overlaps that provide a further layer of sourcing complexity to what is already a hugely complex procurement and development context. The issues and implications of this situation will be examined and it will be argued that the emergence of significant capability imbalances against the background of poor data provide the context for the continued uneven performance of complex software projects. The paper will conclude with an examination of the implications of this situation to the development of complex software projects.",
keywords = "Complex Product Systems (CoPS), Computer software, CENTRIM",
author = "Steve Flowers",
year = "2002",
language = "English",
booktitle = "EURAM 2002",

}

Building the Invisible Palace: Capability gaps, traps and overlaps in complex software projects. / Flowers, Steve.

EURAM 2002. 2002.

Research output: Chapter in Book/Conference proceeding with ISSN or ISBNConference contribution with ISSN or ISBNResearchpeer-review

TY - GEN

T1 - Building the Invisible Palace: Capability gaps, traps and overlaps in complex software projects

AU - Flowers, Steve

PY - 2002

Y1 - 2002

N2 - The growth of the IT industry has been dramatic and information and communication technologies (ICTs) now play a fundamental part in many, if not all, of the critical infrastructures upon which modern society depends. The use of ICTs within organisations of all types is approaching ubiquity with many such systems being viewed as mission critical. This spread and the increasing criticality of such systems itself relies upon the ability to develop complex software systems in a reliable and predictable fashion. However, there is widespread evidence that the development of software in such a fashion continues to present a formidable challenge to many organisations with software typically being delivered late, over budget and with reduced functionality. Whilst large software projects have always posed huge challenges for suppliers of bespoke software, the nature and scale of that challenge has evolved over the years. At the level of the individual firm, modern information systems development takes place in the context of a series of interconnected complexities concerning alignment with organisational goals, primary and secondary sourcing, integration of new systems and backward integration with existing systems. At the level of the industry, these complexities are in turn managed in the context in which specialist capability has largely migrated to the IT services industry, necessitating the involvement of a range of intermediaries. Such work takes place within the wider context of a range of highly flexible technologies with high rates of technical and skill obsolescence. Within this turbulent situation data across a range of performance metrics may be difficult or impossible to obtain with the result that organisations will often operate in the absence of reliable information. This exploratory paper will provide a high-level examination of the major challenges associated with the development of large-scale complex software systems and trace the emergence of the current situation facing many organisations. In order to provide a context for the discussion, the paper will examine the recent growth and development of the software and computer services industry and draw on earlier work that assesses its maturity (Flowers and Brady, 2001). The development of complex sourcing for IT (Venkatraman, 1997) and the rapid growth and expanding role of intermediaries within the software industry will also be examined. The nature and implications of the migration of specialist capability within the IT and software industry will be explored and the paper will build on earlier work in the area (Feeny and Willcocks, 1998) to argue that there has been the emergence of a series of capability gaps, traps and overlaps that provide a further layer of sourcing complexity to what is already a hugely complex procurement and development context. The issues and implications of this situation will be examined and it will be argued that the emergence of significant capability imbalances against the background of poor data provide the context for the continued uneven performance of complex software projects. The paper will conclude with an examination of the implications of this situation to the development of complex software projects.

AB - The growth of the IT industry has been dramatic and information and communication technologies (ICTs) now play a fundamental part in many, if not all, of the critical infrastructures upon which modern society depends. The use of ICTs within organisations of all types is approaching ubiquity with many such systems being viewed as mission critical. This spread and the increasing criticality of such systems itself relies upon the ability to develop complex software systems in a reliable and predictable fashion. However, there is widespread evidence that the development of software in such a fashion continues to present a formidable challenge to many organisations with software typically being delivered late, over budget and with reduced functionality. Whilst large software projects have always posed huge challenges for suppliers of bespoke software, the nature and scale of that challenge has evolved over the years. At the level of the individual firm, modern information systems development takes place in the context of a series of interconnected complexities concerning alignment with organisational goals, primary and secondary sourcing, integration of new systems and backward integration with existing systems. At the level of the industry, these complexities are in turn managed in the context in which specialist capability has largely migrated to the IT services industry, necessitating the involvement of a range of intermediaries. Such work takes place within the wider context of a range of highly flexible technologies with high rates of technical and skill obsolescence. Within this turbulent situation data across a range of performance metrics may be difficult or impossible to obtain with the result that organisations will often operate in the absence of reliable information. This exploratory paper will provide a high-level examination of the major challenges associated with the development of large-scale complex software systems and trace the emergence of the current situation facing many organisations. In order to provide a context for the discussion, the paper will examine the recent growth and development of the software and computer services industry and draw on earlier work that assesses its maturity (Flowers and Brady, 2001). The development of complex sourcing for IT (Venkatraman, 1997) and the rapid growth and expanding role of intermediaries within the software industry will also be examined. The nature and implications of the migration of specialist capability within the IT and software industry will be explored and the paper will build on earlier work in the area (Feeny and Willcocks, 1998) to argue that there has been the emergence of a series of capability gaps, traps and overlaps that provide a further layer of sourcing complexity to what is already a hugely complex procurement and development context. The issues and implications of this situation will be examined and it will be argued that the emergence of significant capability imbalances against the background of poor data provide the context for the continued uneven performance of complex software projects. The paper will conclude with an examination of the implications of this situation to the development of complex software projects.

KW - Complex Product Systems (CoPS)

KW - Computer software

KW - CENTRIM

M3 - Conference contribution with ISSN or ISBN

BT - EURAM 2002

ER -