Topper Copies

AquaTech is a government defence contracting firm specialising in manufacturing robotic systems for police and military use. It is known for producing bomb-defusing robots and working on other classified projects. One critical project involved developing a robot capable of sweeping minefields and detecting hidden explosives. The project had a stringent seven-month deadline to produce a working prototype for a demonstration to top defence ministry officials. The project encountered delays due to staff shortages and other unforeseen issues, resulting in a two-week lag. As the deadline loomed, the project leader pressured the team to work extended hours with minimal rest. Despite these challenges, the team managed to complete the prototype on time for the demonstration. During the demonstration, the robot was deployed in an active minefield to detect mines and mark them with a spray. Initially, the robot performed as expected, identifying mines. However, instead of marking the sites, it triggered explosions, causing fatal injuries to the operating engineer. The demonstration was immediately halted, and an inquiry was launched. The investigation revealed that a software flaw caused the malfunction, leading to the tragic accident. The software development team argued that the operator issued mixed commands, which contributed to the malfunction. Overall, each team kept deflecting responsibility, but somebody or a team had to be made accountable for the fatal errors. (a) If you are the ethics officer of AquaTech enquiring, who will you hold responsible for the fatality? Why? (b) Discuss some common ethical issues that arise while using artificial intelligence.

Diksha Rai, AIR 40, 2025

The given case study deals with the significance of fostering a healthy work-culture for successful operation of any organisation.

| Stakeholder | Stakes | |---|---| | Project leader | leading the team; meeting deadline | | Staff | right to safe and work environment; protection from exploitation | | Aqua Tech firm | Efficiency and Profits | | Government | access to latest Defence technologies; upholding National Security |

(a) As an ethics officer of Aqua Tech firm

I will undertake the following steps:

1. launch a transparent and detailed enquiry to ascertain the person responsible for the tragedy. 2. Giving each holder chance to put forth their perspective (natural justice) & to defend themselves. 3. Ascertain whether the software flaw was due to human error or just a malfunction. 4. Ascertain whether the accident was avoidable or was it an unfortunate malfunction. 5. Ascertain whether there was due diligence by team responsible for dry run of the software as well as the software developers 6. Ascertain whether (i) the malfunction was due to human error; if it was due to undue coercion & pressure of the project leader for making the staff work for extended hours.

Thus I will try to fix the accountability based on the findings of my enquiry.

Developing defence technologies involves crucial responsibilities

Thus pushing the people & working in the project to work for long hours with minimal rest has following issues lack of rest -> leads to decreased productivity & focus. -> Can compromise safety of the technologies -> can be fatal -> compromises national security

Thus as the ethics officer of AquaTech firm I will advise the management to undertake action against the project leader for breaching Rights of the people involved in the project and for potentially being responsible for the fatal injuries to the operating engineer.

I will also undertake measures to foster healthy work culture in the firm which balances the need of productivity & efficiency with safety of the workers and the technology.

(b) Ethical issues involved in using AIs

-> Issue of Data privacy and protection AI & machine learning feed on large amount of data. -> Issue of Bias in algorithms - Amazon's AI recruitment software (2014-15) was biased against women candidates -> Issue of Individual agency ex- Meta's feature of tagging persons automatically. -> Issue of national interest & sovereignty Big tech companies spearheading AI revolution encroaching on sovereign powers & function of state eg- non-cooperating in criminal investigations -> Issue of monopoly (oligarchy) only a few companies dominate this domain. - Ethical issue of human intelligence vs artificial intelligence - humans trying to create a (Sentient) technology, and related ethical issues - Ethical issue of equitable access to AI technology & accountability. - Ethical issue of responsibility, if anything illegal or unethical done by AI.

Thus government regulations should evolve at a pace similar to the pace of developments of AI, if not faster, in order to deal with the ethical issues involved