Thinking Upstream: Ethics and Policy Opportunities in AI Supply Chains

Papers is Alpha. This content is part of an effort to make research more accessible, and (most likely) has lost some details from the original. You can find the original paper here.
Looking upstream

After children were pictured sewing its running shoes in the early 1990s, Nike at first disavowed the “working conditions in its suppliers’ factories”, before public pressure led them to take responsibility for ethics in their upstream supply chain. In 2023, OpenAI responded to criticism that Kenyan workers were paid less than $2 per hour to filter traumatic content from its ChatGPT model by stating in part that it had outsourced the work to a subcontractor, who managed workers’ payment and mental health concerns.
In this position paper,** we argue that policy interventions for AI Ethics must consider AI as a supply chain problem**, given how the political economy and intra-firm relations structure AI production, in particular examining opportunities upstream.
Much like physical goods, software is assembled from components developed by many people across diverse contexts, in a “supply chain”. Widder and Nafus suggested that “thinking about ethics and responsibility as chains of relations surfaces specific locations in which ethical decision-making can take place”. They show how interviewees at dow the AI supply chain view their ethical responsibility differently:developers“high”in the chain saw what they were making as too “general purpose” to warrant ethical scrutiny, but those downstream felt unequipped to remediate “ethical debt” accrued upstream. By analogy to technical debt, “ethical debt”refers to unaddressed flaws that may cause harm downstream, to be “paid” by developers or users who later interact with the system.
However, AI ethics approaches often focus on the component being developed or its downstream effects, rather than its upstream supply chain. Company AI Ethics policy statements often scrutinize design while avoiding scrutiny of downstream business uses. Ethical design principles and checklists are insufficient— satire shows that systems satisfying “Fair”, “Accountable”, “Transparent” design principles can nonetheless be patently unethical when used for harm, and others demonstrate that in cases such as Deepfakes, harm is inherent in how a system is freely distributed and thus widely used, not how it is designed.
Relatedly, efforts like “Privacy by Design” and “Data Protection by Design” are legal (in some jurisdictions) and engineering requirements that embed privacy concerns throughout the development lifecycle for a particular software component. However, a supply chain frame would consider how that component depends on privacy assumptions or affordances from its dependencies developed earlier in the supply chain, and in turn for its downstream users. Gürses and Hoboken noted that privacy research and policy interventions focus on sites of “technology consumption” lower in the supply chain, disregarding modern and drastic changes in software production, upstream in the supply chain.
Ethical design interventions for AI often think downstream, often drawing on design futuring, scenarios, or value sensitive design techniquesto consider how stakeholder harms might occur during the deployment and use of AI systems. While useful, we argue that there are unexplored opportunities for acting upstream.
Acting upstream

Conceiving of AI ethics as a supply chain problem, and then looking up the chain, surfaces “values levers”—practices that can pry open discussion about values and ethics— that present opportunities for policy, design and activism.
AI Supply Chains and Human Rights Law. Fukuda-Parr and Gibbons argue that government and civil society must act to ground AI ethics in human rights frameworks, but note that company AI ethics guidelines misuse “`human rights’ as a rhetorical device” in the “absence of enforceable standards” and regulations. Looking beyond AI supply chains to those of physical goods, such standards and regulations exist. For example, the United States banned “any goods, wares, articles, and merchandise mined, produced, or manufactured wholly or in part” (emphasis added) in Xinjiang, unless companies can prove they were not produced using Uyghur forced labor, and the UK Modern Slavery and Human Trafficking Act requires companies to prevent forced labor in their supply chain. Considering the working conditions of upstream AI data workers, such as low paid annotators, suggests opportunities to apply human rights law to workers in the AI supply chain.
Market-Based Policy Interventions: Disclosures, Procurement, and Choosy Customers. Policy interventions focused on making producers of AI systems disclose information about their upstream practices may create market pressures to address ethical issues. A growing number of institutional investors have expressed interest in investing in companies that meet particular social or ethical standards, often termed “environmental and social good” (ESG). While much ESG interest originates in sustainability, monitoring agencies have begun to attend to companies’ possible digital harms, including labor rights, data privacy, and security. This disclosure is often voluntary and thus non-standardized, but future policy initiatives may explore standardized and compulsory ESG disclosures, incorporating AI supply chain ethics topics. Existing regulatory agencies that require companies to make public disclosures about their business practices, such as the U.S. Securities and Exchange Commission, may play a role here.
Widder and Nafus explore the power of being a “choosy” customer, suggesting that those sourcing software might routinize asking suppliers for model cards, if the data it was trained on was properly consented, if crowd workers labeling the data were paid an appropriate wage”, as is often done in supply chains for physical goods. While not all customers are choosy, governments can be perhaps more easily required to be so, especially important in cases where governmental uses of AI affect people's freedoms and life chances. This may also make this scrutiny more routine and thereby normalized. Writing about how government procurement and adoption of ML systems are _policy_ decisions as well as technical ones, Mulligan and Bamberger advocate for using the power of procurement to require suppliers to utilize “contestable design" which “exposes value-laden features”, which might look like making it possible to challenge upstream software features before their downstream consequences are baked in’. Disclosure-based approaches have drawbacks: Gansky and Mcdonald critique “metadata maximalism”, questioning whether model cards and other “provenance and trajectory documentation [provided] in order to enable transparency” can “steer supplier practice via the discipline of the market”, noting inherently messy AI supply chains.
Design and Activism in the Supply Chain. Design and activist practices can make use of an upstream perspective by creating artifacts and tools that help stakeholders understand, question, and advocate for changes upstream in the AI supply chain. The Algorithmic Equity Toolkit (AEKit) was designed to help citizens and community groups “find out more about a specific automated decision system”, providing questions for advocates to ask policymakers and technology vendors, including upstream questions like where a system’s data came from, who gathered it, with what tools, and for what purpose. Artistic approaches to understanding AI systems, such as Crawford and Joler’s “Anatomy of an AI System” can help surface and publicize supply chain relationships in AI systems for further questioning.
Ethical Licensing. Novel software licenses are increasingly proposed and experimented with in open source projects,which recognize harms from making powerful AI freely available.As opposed to permissive licenses, these require downstream users to think about their upstream dependencies, and the ethical commitments they demand, and how these fit with their own.
In sum, these ways of acting “upstream” present future opportunities for design and policy interventions to address questions of AI Ethics.
Bibliography

   1@article{rakova2020responsible,
   2  year = {2020},
   3  journal = {Conference on Computer-Supported Cooperative Work and Social Computing},
   4  author = {Rakova, Bogdana and Yang, Jingying and Cramer, Henriette and Chowdhury, Rumman},
   5  title = {Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices},
   6}
   7
   8@book{laurent2004understanding,
   9  publisher = {" O'Reilly Media, Inc."},
  10  year = {2004},
  11  author = {Laurent, Andrew M St},
  12  title = {Understanding open source and free software licensing: guide to navigating licensing issues in existing \& new software},
  13}
  14
  15@article{scacchi2004free,
  16  publisher = {IEEE},
  17  year = {2004},
  18  pages = {59--66},
  19  number = {1},
  20  volume = {21},
  21  journal = {IEEE software},
  22  author = {Scacchi, Walt},
  23  title = {Free and open source development practices in the game community},
  24}
  25
  26@article{wang2015effects,
  27  publisher = {Elsevier},
  28  year = {2015},
  29  pages = {2232--2236},
  30  number = {11},
  31  volume = {68},
  32  journal = {Journal of business research},
  33  author = {Wang, David Han-Min and Chen, Pei-Hua and Yu, Tiffany Hui-Kuang and Hsiao, Chih-Yi},
  34  title = {The effects of corporate social responsibility on brand equity and firm performance},
  35}
  36
  37@book{dunbar2019hacking,
  38  publisher = {Princeton University Press},
  39  year = {2019},
  40  volume = {21},
  41  author = {Dunbar-Hester, Christina},
  42  title = {Hacking diversity: The politics of inclusion in open technology cultures},
  43}
  44
  45@book{coleman2012coding,
  46  publisher = {Princeton University Press},
  47  year = {2012},
  48  author = {Coleman, E Gabriella},
  49  title = {Coding freedom: The ethics and aesthetics of hacking},
  50}
  51
  52@inproceedings{gray2019ethical,
  53  year = {2019},
  54  pages = {1--11},
  55  booktitle = {ACM Conference On Human Factors In Computing Systems},
  56  author = {Gray, Colin M and Chivukula, Shruthi Sai},
  57  title = {Ethical mediation in UX practice},
  58}
  59
  60@article{al2015socio,
  61  publisher = {IEEE},
  62  year = {2015},
  63  pages = {30--39},
  64  number = {4},
  65  volume = {13},
  66  journal = {IEEE Security \& Privacy},
  67  author = {Al Sabbagh, Bilal and Kowalski, Stewart},
  68  title = {A socio-technical framework for threat modeling a software supply chain},
  69}
  70
  71@article{brey2004ethical,
  72  publisher = {Emerald Group Publishing Limited},
  73  year = {2004},
  74  journal = {Journal of information, communication and ethics in society},
  75  author = {Brey, Philip},
  76  title = {Ethical aspects of facial recognition systems in public places},
  77}
  78
  79@article{nyholm2016ethics,
  80  publisher = {Springer},
  81  year = {2016},
  82  pages = {1275--1289},
  83  number = {5},
  84  volume = {19},
  85  journal = {Ethical theory and moral practice},
  86  author = {Nyholm, Sven and Smids, Jilles},
  87  title = {The ethics of accident-algorithms for self-driving cars: An applied trolley problem?},
  88}
  89
  90@article{mckay2020predicting,
  91  publisher = {Taylor \& Francis},
  92  year = {2020},
  93  pages = {22--39},
  94  number = {1},
  95  volume = {32},
  96  journal = {Current Issues in Criminal Justice},
  97  author = {McKay, Carolyn},
  98  title = {Predicting risk in criminal procedure: actuarial tools, algorithms, AI and judicial decision-making},
  99}
 100
 101@article{carolan_acting_2020,
 102  file = {Carolan - 2020 - Acting like an algorithm digital farming platform.pdf:/Users/dwidder/Zotero/storage/3YK6H3RL/Carolan - 2020 - Acting like an algorithm digital farming platform.pdf:application/pdf},
 103  pages = {1041--1053},
 104  year = {2020},
 105  month = {December},
 106  author = {Carolan, Michael},
 107  journal = {Agriculture and Human Values},
 108  urldate = {2022-08-02},
 109  number = {4},
 110  language = {en},
 111  abstract = {This paper contributes to our understanding of farm data value chains with assistance from 54 semi-structured interviews and field notes from participant observations. Methodologically, it includes individuals, such as farmers, who hold well-known positionalities within digital agriculture spaces—platforms that include precision farming techniques, farm equipment built on machine learning architecture and algorithms, and robotics—while also including less visible elements and practices. The actors interviewed and materialities and performances observed thus came from spaces and places inhabited by, for example, farmers, crop scientists, statisticians, programmers, and senior leadership in firms located in the U.S. and Canada. The stability of “the” artifacts followed for this project proved challenging, which led to me rethinking how to approach the subject conceptually. The paper is animated by a posthumanist commitment, drawing heavily from assemblage thinking and critical data scholarship coming out of Science and Technology Studies. The argument’s understanding of “chains” therefore lies on an alternative conceptual plane relative to most commodity chain scholarship. To speak of a data value chain is to foreground an orchestrating set of relations among humans, non-humans, products, spaces, places, and practices. The paper’s principle contribution involves interrogating lock-in tendencies at different “points” along the digital farm platform assemblage while pushing for a varied understanding of governance depending on the roles of the actors and actants involved.},
 112  doi = {10.1007/s10460-020-10032-w},
 113  url = {https://link.springer.com/10.1007/s10460-020-10032-w},
 114  shorttitle = {Acting like an algorithm},
 115  issn = {0889-048X, 1572-8366},
 116  volume = {37},
 117  title = {Acting like an algorithm: digital farming platforms and the trajectories they (need not) lock-in},
 118}
 119
 120@article{kahle2000good,
 121  publisher = {FITNESS INFORMATION TECHNOLOGY INC.},
 122  year = {2000},
 123  pages = {43--52},
 124  number = {1},
 125  volume = {9},
 126  journal = {Sport Marketing Quarterly},
 127  author = {Kahle, Lynn R and Boush, David M and Phelps, Mark},
 128  title = {Good morning, Vietnam: An ethical analysis of Nike activities in Southeast Asia},
 129}
 130
 131@mastersthesis{fiorellini2019labor,
 132  school = {Universit{\`a} Ca'Foscari Venezia},
 133  year = {2019},
 134  type = {{B.S.} thesis},
 135  author = {Fiorellini Bernardis, Alvise},
 136  title = {Labor issues and workers’ rights within the global supply chain. How to manage the work environment. The Nike case.},
 137}
 138
 139@article{eggen2002gun,
 140  publisher = {HeinOnline},
 141  year = {2002},
 142  pages = {115},
 143  volume = {81},
 144  journal = {NCL Rev.},
 145  author = {Eggen, Jean Macchiaroli and Culhane, John G},
 146  title = {Gun Torts: Defining a cause of action for victims in suits against gun manufacturers},
 147}
 148
 149@inproceedings{keyes2019mulching,
 150  year = {2019},
 151  pages = {1--11},
 152  booktitle = {Extended Abstracts Of ACM Conference On Human Factors In Computing Systems},
 153  author = {Keyes, Os and Hutson, Jevan and Durbin, Meredith},
 154  title = {A mulching proposal: Analysing and improving an algorithmic system for turning the elderly into high-nutrient slurry},
 155}
 156
 157@article{panasen2019hcdharmful,
 158  year = {2019},
 159  note = {Accessed: 2022-05-2},
 160  author = {Pasanen, Jussi},
 161  title = {Human-Centred Design Considered Harmful},
 162}
 163
 164@article{lipton2018mythos,
 165  publisher = {ACM New York, NY, USA},
 166  year = {2018},
 167  pages = {31--57},
 168  number = {3},
 169  volume = {16},
 170  journal = {Queue},
 171  author = {Lipton, Zachary C},
 172  title = {The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.},
 173}
 174
 175@article{jagtiani2019roles,
 176  publisher = {Wiley Online Library},
 177  year = {2019},
 178  pages = {1009--1029},
 179  number = {4},
 180  volume = {48},
 181  journal = {Financial Management},
 182  author = {Jagtiani, Julapa and Lemieux, Catharine},
 183  title = {The roles of alternative data and machine learning in fintech lending: evidence from the LendingClub consumer platform},
 184}
 185
 186@inproceedings{turkson2016machine,
 187  organization = {IEEE},
 188  year = {2016},
 189  pages = {1--7},
 190  booktitle = {2016 Third International Conference on Artificial Intelligence and Pattern Recognition (AIPR)},
 191  author = {Turkson, Regina Esi and Baagyere, Edward Yeallakuor and Wenya, Gideon Evans},
 192  title = {A machine learning approach for predicting bank credit worthiness},
 193}
 194
 195@article{mccarthy2004applications,
 196  publisher = {Wiley Online Library},
 197  year = {2004},
 198  pages = {239--262},
 199  number = {1},
 200  volume = {1020},
 201  journal = {Annals of the New York Academy of Sciences},
 202  author = {Mccarthy, John F and Marx, Kenneth A and Hoffman, Patrick E and Gee, Alexander G and O'neil, Philip and Ujwal, M L and Hotchkiss, John},
 203  title = {Applications of machine learning and high-dimensional visualization in cancer detection, diagnosis, and management},
 204}
 205
 206@article{berk2017impact,
 207  publisher = {Springer},
 208  year = {2017},
 209  pages = {193--216},
 210  number = {2},
 211  volume = {13},
 212  journal = {Journal of Experimental Criminology},
 213  author = {Berk, Richard},
 214  title = {An impact assessment of machine learning risk forecasts on parole board decisions and recidivism},
 215}
 216
 217@book{cummings2017artificial,
 218  publisher = {Chatham House for the Royal Institute of International Affairs London},
 219  year = {2017},
 220  author = {Cummings, Missy},
 221  title = {Artificial intelligence and the future of warfare},
 222}
 223
 224@article{prates2019assessing,
 225  publisher = {Springer},
 226  year = {2019},
 227  pages = {1--19},
 228  journal = {Neural Computing and Applications},
 229  author = {Prates, Marcelo OR and Avelar, Pedro H and Lamb, Luis C},
 230  title = {Assessing gender bias in machine translation: a case study with google translate},
 231}
 232
 233@article{mittelstadt2019principles,
 234  publisher = {Nature Publishing Group},
 235  year = {2019},
 236  pages = {501--507},
 237  number = {11},
 238  volume = {1},
 239  journal = {Nature Machine Intelligence},
 240  author = {Mittelstadt, Brent},
 241  title = {Principles alone cannot guarantee ethical AI},
 242}
 243
 244@article{crawford2016artificial,
 245  year = {2016},
 246  number = {06},
 247  volume = {25},
 248  journal = {The New York Times},
 249  author = {Crawford, Kate},
 250  title = {Artificial intelligence’s white guy problem},
 251}
 252
 253@article{bird2020fairlearn,
 254  year = {2020},
 255  journal = {Microsoft, Tech. Rep. MSR-TR-2020-32},
 256  author = {Bird, Sarah and Dud{\'\i}k, Miro and Edgar, Richard and Horn, Brandon and Lutz, Roman and Milan, Vanessa and Sameki, Mehrnoosh and Wallach, Hanna and Walker, Kathleen},
 257  title = {Fairlearn: A toolkit for assessing and improving fairness in AI},
 258}
 259
 260@inproceedings{nushi2018towards,
 261  year = {2018},
 262  number = {1},
 263  volume = {6},
 264  booktitle = {AAAI Conference on Human Computation and Crowdsourcing},
 265  author = {Nushi, Besmira and Kamar, Ece and Horvitz, Eric},
 266  title = {Towards accountable ai: Hybrid human-machine analyses for characterizing system failure},
 267}
 268
 269@article{jobin2019global,
 270  publisher = {Nature Publishing Group},
 271  year = {2019},
 272  pages = {389--399},
 273  number = {9},
 274  volume = {1},
 275  journal = {Nature Machine Intelligence},
 276  author = {Jobin, Anna and Ienca, Marcello and Vayena, Effy},
 277  title = {The global landscape of AI ethics guidelines},
 278}
 279
 280@inproceedings{greene2019better,
 281  year = {2019},
 282  booktitle = {52nd Hawaii international conference on system sciences},
 283  author = {Greene, Daniel and Hoffmann, Anna Lauren and Stark, Luke},
 284  title = {Better, nicer, clearer, fairer: A critical assessment of the movement for ethical artificial intelligence and machine learning},
 285}
 286
 287@article{metcalf2019owning,
 288  publisher = {Johns Hopkins University Press},
 289  year = {2019},
 290  pages = {449--476},
 291  number = {2},
 292  volume = {86},
 293  journal = {Social Research: An International Quarterly},
 294  author = {Metcalf, Jacob and Moss, Emanuel and others},
 295  title = {Owning ethics: Corporate logics, silicon valley, and the institutionalization of ethics},
 296}
 297
 298@article{grodzinsky2003ethical,
 299  publisher = {MCB UP Ltd},
 300  year = {2003},
 301  journal = {Journal of Information, Communication and Ethics in Society},
 302  author = {Grodzinsky, Frances S and Miller, Keith and Wolf, Marty J},
 303  title = {Ethical issues in open source software},
 304}
 305
 306@article{wolf2002open,
 307  publisher = {ACM New York, NY, USA},
 308  year = {2002},
 309  pages = {317--318},
 310  number = {1},
 311  volume = {34},
 312  journal = {ACM SIGCSE Bulletin},
 313  author = {Wolf, Marty J and Bowyer, Kevin and Gotterbarn, Don and Miller, Keith},
 314  title = {Open source software: intellectual challenges to the status quo},
 315}
 316
 317@article{wolf2019responsibility,
 318  year = {2019},
 319  pages = {3},
 320  number = {1},
 321  volume = {2019},
 322  journal = {Computer Ethics-Philosophical Enquiry (CEPE) Proceedings},
 323  author = {Wolf, Marty J and Miller, Keith W and Grodzinsky, Frances S},
 324  title = {On the Responsibility for Uses of Downstream Software},
 325}
 326
 327@article{bostrom2017strategic,
 328  publisher = {Wiley Online Library},
 329  year = {2017},
 330  pages = {135--148},
 331  number = {2},
 332  volume = {8},
 333  journal = {Global policy},
 334  author = {Bostrom, Nick},
 335  title = {Strategic implications of openness in AI development},
 336}
 337
 338@article{hibbard2008open,
 339  publisher = {IOS Press},
 340  year = {2008},
 341  pages = {473},
 342  volume = {171},
 343  journal = {Frontiers in Artificial Intelligence and Applications},
 344  author = {Hibbard, Bill},
 345  title = {Open source AI},
 346}
 347
 348@inproceedings{holstein2019improving,
 349  year = {2019},
 350  pages = {1--16},
 351  booktitle = {ACM Conference On Human Factors In Computing Systems},
 352  author = {Holstein, Kenneth and Wortman Vaughan, Jennifer and Daum{\'e} III, Hal and Dudik, Miro and Wallach, Hanna},
 353  title = {Improving fairness in machine learning systems: What do industry practitioners need?},
 354}
 355
 356@article{cramer2019challenges,
 357  year = {2019},
 358  journal = {FAT* Tutorial},
 359  author = {Cramer, Henriette and Vaughan, Jenn Wortman and Holstein, Ken and Wallach, Hanna and Garcia-Gathright, Jean and Daum{\'e} III, Hal and Dud{\'\i}k, Miroslav and Reddy, Sravana},
 360  title = {Challenges of incorporating algorithmic fairness into industry practice},
 361}
 362
 363@article{van2010ethical,
 364  year = {2010},
 365  pages = {1--10},
 366  journal = {Communications of the IBIMA},
 367  author = {Van den Bergh, Joachim and Deschoolmeester, Dirk},
 368  title = {Ethical decision making in ICT: discussing the impact of an ethical code of conduct},
 369}
 370
 371@article{manders2009values,
 372  year = {2009},
 373  pages = {37--44},
 374  volume = {10},
 375  journal = {The International Review of Information Ethics},
 376  author = {Manders-Huits, No{\"e}mi and Zimmer, Michael},
 377  title = {Values and pragmatic action: The challenges of introducing ethical intelligence in technical design communities},
 378}
 379
 380@inproceedings{madaio2020co,
 381  year = {2020},
 382  pages = {1--14},
 383  booktitle = {ACM Conference On Human Factors In Computing Systems},
 384  author = {Madaio, Michael A and Stark, Luke and Wortman Vaughan, Jennifer and Wallach, Hanna},
 385  title = {Co-designing checklists to understand organizational challenges and opportunities around fairness in ai},
 386}
 387
 388@article{roberts2003supply,
 389  publisher = {Springer},
 390  year = {2003},
 391  pages = {159--170},
 392  number = {2},
 393  volume = {44},
 394  journal = {Journal of business ethics},
 395  author = {Roberts, Sarah},
 396  title = {Supply chain specific? Understanding the patchy success of ethical sourcing initiatives},
 397}
 398
 399@inproceedings{zhou2019fork,
 400  year = {2019},
 401  pages = {350--361},
 402  booktitle = {27th Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering},
 403  author = {Zhou, Shurui and Vasilescu, Bogdan and K{\"a}stner, Christian},
 404  title = {What the fork: a study of inefficient and efficient forking practices in social coding},
 405}
 406
 407@misc{abrassart_dilhac_2018,
 408  year = {2018},
 409  author = {Abrassart, Christophe and Dilhac, Marc-Antoine},
 410  publisher = {University of Montreal},
 411  journal = {Participant Workbook "Be part of Collective Thinking: Montreal Declaration for a responsible development of Artificial Intelligence"},
 412  place = {Montreal},
 413}
 414
 415@misc{declaration2018montreal,
 416  year = {2018},
 417  author = {Declaration, Montreal},
 418  title = {The Montreal Declaration for the Responsible Development of Artificial Intelligence},
 419}
 420
 421@article{oh2007membership,
 422  publisher = {INFORMS},
 423  year = {2007},
 424  pages = {1086--1101},
 425  number = {7},
 426  volume = {53},
 427  journal = {Management science},
 428  author = {Oh, Wonseok and Jeon, Sangyong},
 429  title = {Membership herding and network stability in the open source community: The Ising perspective},
 430}
 431
 432@article{daniel2020impact,
 433  year = {2020},
 434  pages = {146--171},
 435  number = {3},
 436  volume = {12},
 437  journal = {AIS Transactions on Human-Computer Interaction},
 438  author = {Daniel, Sherae L and Chung, Ting-Ting Rachel and Sharma, Pratyush Nidhi},
 439  title = {The Impact of Anonymous Peripheral Contributions on Open Source Software Development},
 440}
 441
 442@article{abrassart2018montreal,
 443  year = {2018},
 444  author = {Abrassart, Christophe and Bengio, Yoshua and Chicoisine, G and De Marcellis, N and Warin, M and Dilhac, Gambs and others},
 445  title = {Montreal Declaration for Responsible Development of Artificial Intelligence},
 446}
 447
 448@article{kietzmann2020deepfakes,
 449  publisher = {Elsevier},
 450  year = {2020},
 451  pages = {135--146},
 452  number = {2},
 453  volume = {63},
 454  journal = {Business Horizons},
 455  author = {Kietzmann, Jan and Lee, Linda W and McCarthy, Ian P and Kietzmann, Tim C},
 456  title = {Deepfakes: Trick or treat?},
 457}
 458
 459@article{geiger2017summary,
 460  year = {2017},
 461  journal = {arXiv preprint arXiv:1706.02777},
 462  author = {Geiger, R Stuart},
 463  title = {Summary analysis of the 2017 github open source survey},
 464}
 465
 466@inproceedings{ohm2020backstabber,
 467  organization = {Springer},
 468  year = {2020},
 469  pages = {23--43},
 470  booktitle = {International Conference on Detection of Intrusions and Malware, and Vulnerability Assessment},
 471  author = {Ohm, Marc and Plate, Henrik and Sykosch, Arnold and Meier, Michael},
 472  title = {Backstabber’s Knife Collection: A Review of Open Source Software Supply Chain Attacks},
 473}
 474
 475@inproceedings{dabbish2012social,
 476  year = {2012},
 477  pages = {1277--1286},
 478  booktitle = {conference on computer supported cooperative work},
 479  author = {Dabbish, Laura and Stuart, Colleen and Tsay, Jason and Herbsleb, Jim},
 480  title = {Social coding in GitHub: transparency and collaboration in an open software repository},
 481}
 482
 483@article{sharp2016role,
 484  publisher = {IEEE},
 485  year = {2016},
 486  pages = {786--804},
 487  number = {8},
 488  volume = {42},
 489  journal = {IEEE Transactions on Software Engineering},
 490  author = {Sharp, Helen and Dittrich, Yvonne and De Souza, Cleidson RB},
 491  title = {The role of ethnographic studies in empirical software engineering},
 492}
 493
 494@article{lincoln2011paradigmatic,
 495  year = {2011},
 496  pages = {97--128},
 497  volume = {4},
 498  journal = {The Sage handbook of qualitative research},
 499  author = {Lincoln, Yvonna S and Lynham, Susan A and Guba, Egon G},
 500  title = {Paradigmatic controversies, contradictions, and emerging confluences, revisited},
 501}
 502
 503@article{white2009ethnography,
 504  year = {2009},
 505  pages = {18--27},
 506  number = {1},
 507  volume = {9},
 508  journal = {Qualitative Research Journal},
 509  author = {White, Julie and Drew, Sarah and Hay, Trevor},
 510  title = {Ethnography versus case study},
 511}
 512
 513@book{willis2007foundations,
 514  publisher = {Sage},
 515  year = {2007},
 516  author = {Willis, Jerry W and Jost, Muktha and Nilakanta, Rema},
 517  title = {Foundations of qualitative research: Interpretive and critical approaches},
 518}
 519
 520@book{weiss1995learning,
 521  publisher = {Simon and Schuster},
 522  year = {1995},
 523  author = {Weiss, Robert S},
 524  title = {Learning from strangers: The art and method of qualitative interview studies},
 525}
 526
 527@book{strauss1997grounded,
 528  publisher = {Sage},
 529  year = {1997},
 530  author = {Strauss, Anselm and Corbin, Juliet M},
 531  title = {Grounded theory in practice},
 532}
 533
 534@article{righi2013card,
 535  publisher = {Usability Professionals' Association Bloomingdale, IL},
 536  year = {2013},
 537  pages = {69--89},
 538  number = {3},
 539  volume = {8},
 540  journal = {Journal of Usability Studies},
 541  author = {Righi, Carol and James, Janice and Beasley, Michael and Day, Donald L and Fox, Jean E and Gieber, Jennifer and Howe, Chris and Ruby, Laconya},
 542  title = {Card sort analysis best practices},
 543}
 544
 545@article{perens2005emerging,
 546  year = {2005},
 547  journal = {First Monday},
 548  author = {Perens, Bruce},
 549  title = {The emerging economic paradigm of open source},
 550}
 551
 552@article{lerner2002some,
 553  publisher = {Wiley Online Library},
 554  year = {2002},
 555  pages = {197--234},
 556  number = {2},
 557  volume = {50},
 558  journal = {The journal of industrial economics},
 559  author = {Lerner, Josh and Tirole, Jean},
 560  title = {Some simple economics of open source},
 561}
 562
 563@inproceedings{weiss2010profiting,
 564  year = {2010},
 565  pages = {1--8},
 566  booktitle = {15th European Conference on Pattern Languages of Programs},
 567  author = {Weiss, Michael},
 568  title = {Profiting from open source},
 569}
 570
 571@article{latour1992shaping,
 572  year = {1992},
 573  pages = {225--258},
 574  journal = {W. Bijker \& J. Law (Eds.)},
 575  author = {Latour, Bruno and Bijker, Wiebe E and Law, John},
 576  title = {Shaping technology/building society: Studies in sociotechnical change},
 577}
 578
 579@incollection{nissenbaum2017computing,
 580  publisher = {Routledge},
 581  year = {2017},
 582  pages = {273--280},
 583  booktitle = {Computer Ethics},
 584  author = {Nissenbaum, Helen},
 585  title = {Computing and accountability},
 586}
 587
 588@incollection{arendt1987collective,
 589  publisher = {Springer},
 590  year = {1987},
 591  pages = {43--50},
 592  booktitle = {Amor mundi},
 593  author = {Arendt, Hannah},
 594  title = {Collective responsibility},
 595}
 596
 597@article{feinberg1968collective,
 598  year = {1968},
 599  pages = {674--688},
 600  number = {21},
 601  volume = {65},
 602  journal = {The Journal of Philosophy},
 603  author = {Feinberg, Joel},
 604  title = {Collective responsibility},
 605}
 606
 607@book{smith1849dictionary,
 608  publisher = {CC Little and J. Brown},
 609  year = {1849},
 610  volume = {3},
 611  author = {Smith, William},
 612  title = {Dictionary of Greek and Roman biography and mythology},
 613}
 614
 615@inproceedings{marlow2013activity,
 616  year = {2013},
 617  pages = {145--156},
 618  booktitle = {conference on Computer supported cooperative work},
 619  author = {Marlow, Jennifer and Dabbish, Laura},
 620  title = {Activity traces and signals in software developer recruitment and hiring},
 621}
 622
 623@article{hu2012reputation,
 624  publisher = {Elsevier},
 625  year = {2012},
 626  pages = {526--533},
 627  number = {3},
 628  volume = {53},
 629  journal = {Decision Support Systems},
 630  author = {Hu, Daning and Zhao, J Leon and Cheng, Jiesi},
 631  title = {Reputation management in an open source developer social network: An empirical study on determinants of positive evaluations},
 632}
 633
 634@article{jansen2015streisand,
 635  year = {2015},
 636  author = {Jansen, Sue Curry and Martin, Brian},
 637  title = {The Streisand effect and censorship backfire},
 638}
 639
 640@article{macqueen1998codebook,
 641  publisher = {Sage Publications Sage CA: Los Angeles, CA},
 642  year = {1998},
 643  pages = {31--36},
 644  number = {2},
 645  volume = {10},
 646  journal = {Cam Journal},
 647  author = {MacQueen, Kathleen M and McLellan, Eleanor and Kay, Kelly and Milstein, Bobby},
 648  title = {Codebook development for team-based qualitative analysis},
 649}
 650
 651@article{thomas2003general,
 652  publisher = {Citeseer},
 653  year = {2003},
 654  author = {Thomas, David R},
 655  title = {A general inductive approach for qualitative data analysis},
 656}
 657
 658@article{nafus2012patches,
 659  publisher = {Sage Publications Sage UK: London, England},
 660  year = {2012},
 661  pages = {669--683},
 662  number = {4},
 663  volume = {14},
 664  journal = {New Media \& Society},
 665  author = {Nafus, Dawn},
 666  title = {‘Patches don’t have gender’: What is not open in open source software},
 667}
 668
 669@misc{chandler1995technological,
 670  year = {1995},
 671  author = {Chandler, Daniel},
 672  title = {Technological or media determinism},
 673}
 674
 675@book{pacey1983culture,
 676  publisher = {MIT press},
 677  year = {1983},
 678  author = {Pacey, Arnold},
 679  title = {The culture of technology},
 680}
 681
 682@book{mumford1970pentagon,
 683  publisher = {Houghton Mifflin Harcourt P},
 684  year = {1970},
 685  volume = {2},
 686  author = {Mumford, Lewis},
 687  title = {The pentagon of power},
 688}
 689
 690@article{schneider1994nuclear,
 691  publisher = {Blackwell Publishing Ltd Oxford, UK},
 692  year = {1994},
 693  pages = {209--234},
 694  number = {Supplement\_2},
 695  volume = {38},
 696  journal = {Mershon International Studies Review},
 697  author = {Schneider, Barry R},
 698  title = {Nuclear proliferation and counter-proliferation: Policy issues and debates},
 699}
 700
 701@article{selinger2012philosophy,
 702  year = {2012},
 703  volume = {23},
 704  journal = {The Atlantic},
 705  author = {Selinger, Evan},
 706  title = {The Philosophy of the Technology of the Gun},
 707}
 708
 709@article{latour1994technical,
 710  pages = {29--64},
 711  year = {1994},
 712  number = {2},
 713  volume = {3},
 714  journal = {Common knowledge},
 715  author = {Latour, Bruno},
 716  title = {On technical mediation},
 717}
 718
 719@article{ihde1990technology,
 720  year = {1990},
 721  author = {Ihde, Don},
 722  title = {Technology and the lifeworld: From garden to earth},
 723}
 724
 725@article{li2021code,
 726  publisher = {ACM New York, NY, USA},
 727  year = {2021},
 728  pages = {1--31},
 729  number = {CSCW1},
 730  volume = {5},
 731  journal = {Conference On Computer-Supported Cooperative Work And Social Computing},
 732  author = {Li, Renee and Pandurangan, Pavitthra and Frluckaj, Hana and Dabbish, Laura},
 733  title = {Code of Conduct Conversations in Open Source Software Projects on Github},
 734}
 735
 736@article{singh2021codes,
 737  publisher = {Springer},
 738  year = {2021},
 739  pages = {1--40},
 740  journal = {Software Quality Journal},
 741  author = {Singh, Vandana and Bongiovanni, Brice and Brandon, William},
 742  title = {Codes of conduct in Open Source Software—for warm and fuzzy feelings or equality in community?},
 743}
 744
 745@article{burkhardt2019mapping,
 746  publisher = {transcript},
 747  year = {2019},
 748  author = {Burkhardt, Marcus},
 749  title = {Mapping the Democratization of AI on GitHub. A First Approach},
 750}
 751
 752@book{kelty2008two,
 753  publisher = {Duke University Press},
 754  year = {2008},
 755  author = {Kelty, Christopher M},
 756  title = {Two bits: The cultural significance of free software},
 757}
 758
 759@article{rudin2018age,
 760  year = {2018},
 761  journal = {arXiv preprint arXiv:1811.00731},
 762  author = {Rudin, Cynthia and Wang, Caroline and Coker, Beau},
 763  title = {The age of secrecy and unfairness in recidivism prediction},
 764}
 765
 766@article{biddle2020predicting,
 767  publisher = {Cambridge University Press},
 768  year = {2020},
 769  pages = {1--21},
 770  journal = {Canadian Journal of Philosophy},
 771  author = {Biddle, Justin B},
 772  title = {On predicting recidivism: epistemic risk, tradeoffs, and values in machine learning},
 773}
 774
 775@article{alexander2002working,
 776  publisher = {Taylor \& Francis},
 777  year = {2002},
 778  pages = {25--39},
 779  number = {3},
 780  volume = {6},
 781  journal = {International journal of electronic commerce},
 782  author = {Alexander Hars, Shaosong Ou},
 783  title = {Working for free? Motivations for participating in open-source projects},
 784}
 785
 786@article{hertel2003motivation,
 787  publisher = {Elsevier},
 788  year = {2003},
 789  pages = {1159--1177},
 790  number = {7},
 791  volume = {32},
 792  journal = {Research policy},
 793  author = {Hertel, Guido and Niedner, Sven and Herrmann, Stefanie},
 794  title = {Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel},
 795}
 796
 797@article{ananny2018seeing,
 798  publisher = {SAGE Publications Sage UK: London, England},
 799  year = {2018},
 800  pages = {973--989},
 801  number = {3},
 802  volume = {20},
 803  journal = {new media \& society},
 804  author = {Ananny, Mike and Crawford, Kate},
 805  title = {Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability},
 806}
 807
 808@article{gebru2019oxford,
 809  year = {2019},
 810  journal = {arXiv preprint arXiv:1908.06165},
 811  author = {Gebru, Timnit},
 812  title = {Oxford handbook on AI ethics book chapter on race and gender},
 813}
 814
 815@article{benjamin2019race,
 816  year = {2019},
 817  journal = {Social Forces},
 818  author = {Benjamin, Ruha},
 819  title = {Race after technology: Abolitionist tools for the new jim code},
 820}
 821
 822@inproceedings{benjamin2020put,
 823  year = {2020},
 824  booktitle = {Resistance AI Workshop at NeurIPS2020},
 825  author = {Benjamin, Garfield},
 826  title = {" Put It In the Bin": Mapping AI as a framework of refusal},
 827}
 828
 829@book{ruggie_2011,
 830  year = {2011},
 831  author = {Ruggie, John},
 832  institution = {UN Human Rights Council},
 833  journal = {UN Guiding Principles on Business and Human Rights: Implementing the United Nations “Protect, Respect and Remedy” Framework},
 834  place = {New York and Geneva},
 835}
 836
 837@article{open2010history,
 838  year = {2009},
 839  pages = {2009},
 840  volume = {4},
 841  journal = {Retrieved February},
 842  author = {Tiemann, M and Open Source Initiative},
 843  title = {History of the OSI (Open Source Initiative)},
 844}
 845
 846@article{su2021critical,
 847  publisher = {ACM New York, NY, USA},
 848  year = {2021},
 849  pages = {1--27},
 850  number = {CSCW1},
 851  volume = {5},
 852  journal = {Conference On Computer-Supported Cooperative Work And Social Computing},
 853  author = {Su, Norman Makoto and Lazar, Amanda and Irani, Lilly},
 854  title = {Critical Affects: Tech Work Emotions Amidst the Techlash},
 855}
 856
 857@incollection{stark2021critical,
 858  publisher = {Springer},
 859  year = {2021},
 860  pages = {257--280},
 861  booktitle = {The Cultural Life of Machine Learning},
 862  author = {Stark, Luke and Greene, Daniel and Hoffmann, Anna Lauren},
 863  title = {Critical Perspectives on Governance Mechanisms for AI/ML Systems},
 864}
 865
 866@article{nyt2018maven,
 867  year = {2018},
 868  month = {June},
 869  day = {1},
 870  author = {Wakabayashi, Daisuke and Shane, Scott},
 871  journal = {The New York Times},
 872  note = {Accessed: 2021-07-1},
 873  howpublished = {\url{https://www.nytimes.com/2018/06/01/technology/google-pentagon-project-maven.html}},
 874  title = {Google Will Not Renew Pentagon Contract That Upset Employees},
 875}
 876
 877@article{fsf2021definition,
 878  year = {2021},
 879  month = {February},
 880  day = {2},
 881  author = {Stallman, Richard and others},
 882  journal = {The Free Software Foundation},
 883  note = {Accessed: 2021-07-1},
 884  howpublished = {\url{https://www.gnu.org/philosophy/free-sw.en.html}},
 885  title = {What is free software?, The Free Software Definition, Version 1.169},
 886}
 887
 888@article{fsf2016limitfreedom,
 889  year = {2016},
 890  month = {November},
 891  day = {18},
 892  author = {Stallman, Richard},
 893  journal = {The Free Software Foundation},
 894  note = {Accessed: 2021-07-1},
 895  howpublished = {\url{https://www.gnu.org/philosophy/free-sw.en.html}},
 896  title = {Why programs must not limit the freedom to run them},
 897}
 898
 899@article{techcrunch2020youtube,
 900  year = {2020},
 901  month = {October},
 902  day = {23},
 903  author = {Coldewey, Devin},
 904  journal = {Tech Crunch},
 905  note = {Accessed: 2021-07-1},
 906  howpublished = {\url{https://techcrunch.com/2020/10/23/the-riaa-is-coming-for-the-youtube-downloaders/}},
 907  title = {The RIAA is coming for the YouTube downloaders},
 908}
 909
 910@article{japantimes2020deepfake,
 911  year = {2020},
 912  month = {October},
 913  day = {2},
 914  author = {Jiji},
 915  journal = {The Japan Times},
 916  note = {Accessed: 2021-07-1},
 917  howpublished = {\url{https://www.japantimes.co.jp/news/2020/10/02/national/crime-legal/two-men-arrested-deepfake-pornography-videos/}},
 918  title = {The RIAA is coming for the YouTube downloaders},
 919}
 920
 921@article{tomalin2021practical,
 922  publisher = {Springer},
 923  year = {2021},
 924  pages = {1--15},
 925  journal = {Ethics and Information Technology},
 926  author = {Tomalin, Marcus and Byrne, Bill and Concannon, Shauna and Saunders, Danielle and Ullmann, Stefanie},
 927  title = {The practical ethics of bias reduction in machine translation: Why domain adaptation is better than data debiasing},
 928}
 929
 930@article{chouldechova2020snapshot,
 931  publisher = {ACM New York, NY, USA},
 932  year = {2020},
 933  pages = {82--89},
 934  number = {5},
 935  volume = {63},
 936  journal = {Communications of the ACM},
 937  author = {Chouldechova, Alexandra and Roth, Aaron},
 938  title = {A snapshot of the frontiers of fairness in machine learning},
 939}
 940
 941@inproceedings{amini2019uncovering,
 942  year = {2019},
 943  pages = {289--295},
 944  booktitle = {AAAI/ACM Conference on AI, Ethics, and Society},
 945  author = {Amini, Alexander and Soleimany, Ava P and Schwarting, Wilko and Bhatia, Sangeeta N and Rus, Daniela},
 946  title = {Uncovering and mitigating algorithmic bias through learned latent structure},
 947}
 948
 949@article{stieger2006using,
 950  publisher = {Mary Ann Liebert, Inc. 2 Madison Avenue Larchmont, NY 10538 USA},
 951  year = {2006},
 952  pages = {552--559},
 953  number = {5},
 954  volume = {9},
 955  journal = {CyberPsychology \& Behavior},
 956  author = {Stieger, Stefan and G{\"o}ritz, Anja S},
 957  title = {Using instant messaging for Internet-based interviews},
 958}
 959
 960@article{schewe1993sexual,
 961  publisher = {Springer},
 962  year = {1993},
 963  pages = {339--351},
 964  number = {4},
 965  volume = {8},
 966  journal = {Violence and Victims},
 967  author = {Schewe, Paul A and O'donohue, William},
 968  title = {Sexual abuse prevention with high-risk males: The roles of victim empathy and rape myths},
 969}
 970
 971@article{mantelero2018ai,
 972  publisher = {Elsevier},
 973  year = {2018},
 974  pages = {754--772},
 975  number = {4},
 976  volume = {34},
 977  journal = {Computer Law \& Security Review},
 978  author = {Mantelero, Alessandro},
 979  title = {AI and Big Data: A blueprint for a human rights, social and ethical impact assessment},
 980}
 981
 982@article{tensorflow2020doshi,
 983  year = {2020},
 984  month = {June},
 985  day = {29},
 986  author = {Doshi, Tulsee and  Zaldivar, Andrew},
 987  journal = {TensorFlow Blog},
 988  note = {Accessed: 2021-07-7},
 989  howpublished = {\url{https://blog.tensorflow.org/2020/06/responsible-ai-with-tensorflow.html}},
 990  title = {Responsible AI with TensorFlow},
 991}
 992
 993@inproceedings{cramer2019translation,
 994  year = {2019},
 995  pages = {1--8},
 996  booktitle = {Extended Abstracts ACM Conference On Human Factors In Computing Systems},
 997  author = {Cramer, Henriette and Garcia-Gathright, Jean and Reddy, Sravana and Springer, Aaron and Takeo Bouyer, Romain},
 998  title = {Translation, tracks \& data: an algorithmic bias effort in practice},
 999}
1000
1001@article{deon2018checklist,
1002  year = {2019},
1003  journal = {DrivenData},
1004  note = {Accessed: 2021-07-7},
1005  howpublished = {\url{https://deon.drivendata.org}},
1006  title = {Google Will Not Renew Pentagon Contract That Upset Employees},
1007}
1008
1009@article{wong2020democratizing,
1010  publisher = {Springer},
1011  year = {2020},
1012  pages = {225--244},
1013  number = {2},
1014  volume = {33},
1015  journal = {Philosophy \& Technology},
1016  author = {Wong, Pak-Hang},
1017  title = {Democratizing algorithmic fairness},
1018}
1019
1020@article{stallman_opensource_misses,
1021  author = {Stallman, Richard},
1022  journal = {The Free Software Foundation},
1023  note = {Accessed: 2021-07-1},
1024  howpublished = {\url{https://www.gnu.org/philosophy/open-source-misses-the-point.en.html}},
1025  title = {Why Open Source misses the point of Free Software},
1026}
1027
1028@article{ajder2019state,
1029  year = {2019},
1030  journal = {Amsterdam: Deeptrace},
1031  author = {Ajder, Henry and Patrini, Giorgio and Cavalli, Francesco and Cullen, Laurence},
1032  title = {The state of deepfakes: Landscape, threats, and impact},
1033}
1034
1035@inproceedings{veale2018fairness,
1036  year = {2018},
1037  pages = {1--14},
1038  booktitle = {ACM Conference On Human Factors In Computing Systems},
1039  author = {Veale, Michael and Van Kleek, Max and Binns, Reuben},
1040  title = {Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making},
1041}
1042
1043@article{harris2018deepfakes,
1044  publisher = {HeinOnline},
1045  year = {2018},
1046  pages = {99},
1047  volume = {17},
1048  journal = {Duke L. \& Tech. Rev.},
1049  author = {Harris, Douglas},
1050  title = {Deepfakes: False pornography is here and the law cannot protect you},
1051}
1052
1053@book{greene2021promise,
1054  publisher = {MIT Press},
1055  year = {2021},
1056  author = {Greene, Daniel},
1057  title = {The Promise of Access: Technology, Inequality, and the Political Economy of Hope},
1058}
1059
1060@article{maddocks2020deepfake,
1061  publisher = {Taylor \& Francis},
1062  year = {2020},
1063  pages = {415--423},
1064  number = {4},
1065  volume = {7},
1066  journal = {Porn Studies},
1067  author = {Maddocks, Sophie},
1068  title = {‘A Deepfake Porn Plot Intended to Silence Me’: exploring continuities between pornographic and ‘political’deep fakes},
1069}
1070
1071@article{winter2020deepfakes,
1072  publisher = {Taylor \& Francis},
1073  year = {2020},
1074  pages = {382--397},
1075  number = {4},
1076  volume = {7},
1077  journal = {Porn Studies},
1078  author = {Winter, Rachel and Salter, Anastasia},
1079  title = {DeepFakes: uncovering hardcore open source on GitHub},
1080}
1081
1082@article{orr2020attributions,
1083  publisher = {Taylor \& Francis},
1084  year = {2020},
1085  pages = {719--735},
1086  number = {5},
1087  volume = {23},
1088  journal = {Information, Communication \& Society},
1089  author = {Orr, Will and Davis, Jenny L},
1090  title = {Attributions of ethical responsibility by Artificial Intelligence practitioners},
1091}
1092
1093@article{ananny2016toward,
1094  publisher = {SAGE Publications Sage CA: Los Angeles, CA},
1095  year = {2016},
1096  pages = {93--117},
1097  number = {1},
1098  volume = {41},
1099  journal = {Science, Technology, \& Human Values},
1100  author = {Ananny, Mike},
1101  title = {Toward an ethics of algorithms: Convening, observation, probability, and timeliness},
1102}
1103
1104@article{murphy2009beyond,
1105  publisher = {IEEE},
1106  year = {2009},
1107  pages = {14--20},
1108  number = {4},
1109  volume = {24},
1110  journal = {IEEE intelligent systems},
1111  author = {Murphy, Robin and Woods, David D},
1112  title = {Beyond Asimov: the three laws of responsible robotics},
1113}
1114
1115@article{awad2018moral,
1116  publisher = {Nature Publishing Group},
1117  year = {2018},
1118  pages = {59--64},
1119  number = {7729},
1120  volume = {563},
1121  journal = {Nature},
1122  author = {Awad, Edmond and Dsouza, Sohan and Kim, Richard and Schulz, Jonathan and Henrich, Joseph and Shariff, Azim and Bonnefon, Jean-Fran{\c{c}}ois and Rahwan, Iyad},
1123  title = {The moral machine experiment},
1124}
1125
1126@book{yin2017case,
1127  publisher = {Sage publications},
1128  year = {2017},
1129  author = {Yin, Robert K},
1130  title = {Case study research and applications: Design and methods},
1131}
1132
1133@article{tech_workers_bill_of_rights,
1134  year = {2020},
1135  journal = {Tech Workers Coalition},
1136  note = {Accessed: 2021-010-1},
1137  howpublished = {\url{https://techworkerscoalition.org/bill-of-rights/}},
1138  title = {A Tech Workers’ Bill of Rights},
1139}
1140
1141@article{whittaker2021steep,
1142  publisher = {ACM New York, NY, USA},
1143  year = {2021},
1144  pages = {50--55},
1145  number = {6},
1146  volume = {28},
1147  journal = {Interactions},
1148  author = {Whittaker, Meredith},
1149  title = {The steep cost of capture},
1150}
1151
1152@book{miles1994qualitative,
1153  publisher = {sage},
1154  year = {1994},
1155  author = {Miles, Matthew B and Huberman, A Michael},
1156  title = {Qualitative data analysis: An expanded sourcebook},
1157}
1158
1159@article{gauthier1970designing,
1160  publisher = {NJ},
1161  year = {1970},
1162  author = {Gauthier, Richard L and Ponto, Stephen D},
1163  title = {Designing systems programs},
1164}
1165
1166@inproceedings{devanbu2003modularity,
1167  year = {2003},
1168  pages = {723--724},
1169  booktitle = {25th International Conference on Software Engineering},
1170  author = {Devanbu, Premkumar and Balzer, Bob and Batory, Don and Kiczales, Gregor and Launchbury, John and Parnas, David and Tarr, Peri},
1171  title = {Modularity in the new millenium: A panel summary},
1172}
1173
1174@incollection{parnas1972criteria,
1175  publisher = {Springer},
1176  year = {1972},
1177  pages = {479--498},
1178  booktitle = {Pioneers and Their Contributions to Software Engineering},
1179  author = {Parnas, David L},
1180  title = {On the criteria to be used in decomposing systems into modules},
1181}
1182
1183@article{shaw2015seminal,
1184  publisher = {Carnegie Mellon University},
1185  year = {2015},
1186  author = {Shaw, Mary and Aldrich, Jonathan and Breaux, Travis D and Garlan, David and K{\"a}stner, Christian and Le Goues, Claire and Scherlis, William},
1187  title = {Seminal Papers in Software Engineering: The Carnegie Mellon Canonical Collection},
1188}
1189
1190@inproceedings{sambasivan2021everyone,
1191  year = {2021},
1192  pages = {1--15},
1193  booktitle = {ACM Conference On Human Factors In Computing Systems},
1194  author = {Sambasivan, Nithya and Kapania, Shivani and Highfill, Hannah and Akrong, Diana and Paritosh, Praveen and Aroyo, Lora M},
1195  title = {“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI},
1196}
1197
1198@article{wong2021tactics,
1199  publisher = {ACM New York, NY, USA},
1200  year = {2021},
1201  pages = {1--28},
1202  number = {CSCW2},
1203  volume = {5},
1204  journal = {Conference on Human-Computer Interaction},
1205  author = {Wong, Richmond Y},
1206  title = {Tactics of Soft Resistance in User Experience Professionals' Values Work},
1207}
1208
1209@article{lally2021makes,
1210  publisher = {Taylor \& Francis},
1211  year = {2021},
1212  pages = {1--19},
1213  journal = {Urban Geography},
1214  author = {Lally, Nick},
1215  title = {“It makes almost no difference which algorithm you use”: on the modularity of predictive policing},
1216}
1217
1218@book{mcpherson2018feminist,
1219  publisher = {Harvard University Press},
1220  year = {2018},
1221  volume = {6},
1222  author = {McPherson, Tara},
1223  title = {Feminist in a Software Lab: Difference+ Design},
1224}
1225
1226@article{kopytoff1986cultural,
1227  publisher = {Cambridge},
1228  year = {1986},
1229  pages = {70--73},
1230  volume = {68},
1231  journal = {The social life of things: Commodities in cultural perspective},
1232  author = {Kopytoff, Igor},
1233  title = {The cultural biography of things: commoditization as process},
1234}
1235
1236@article{strathern1996cutting,
1237  publisher = {JSTOR},
1238  year = {1996},
1239  pages = {517--535},
1240  journal = {Journal of the Royal Anthropological Institute},
1241  author = {Strathern, Marilyn},
1242  title = {Cutting the network},
1243}
1244
1245@article{suchman2002located,
1246  year = {2002},
1247  pages = {7},
1248  number = {2},
1249  volume = {14},
1250  journal = {Scandinavian journal of information systems},
1251  author = {Suchman, Lucy},
1252  title = {Located accountabilities in technology production},
1253}
1254
1255@article{proctor2008agnotology,
1256  year = {2008},
1257  author = {Proctor, Robert N and Schiebinger, Londa},
1258  title = {Agnotology: The making and unmaking of ignorance},
1259}
1260
1261@incollection{nafus2021ground,
1262  doi = {10.7551/mitpress/11310.003.0005},
1263  publisher = {The MIT Press},
1264  month = {08},
1265  year = {2021},
1266  booktitle = {Making and Doing: Activating STS through Knowledge Expression and Travel},
1267  author = {Nafus, Dawn},
1268  isbn = {9780262366052},
1269  title = {The Ground Keeps Opening Up: Building An Infrastructure For Data Appropriation},
1270}
1271
1272@article{petrozzino2021pays,
1273  publisher = {Springer},
1274  year = {2021},
1275  pages = {205--208},
1276  number = {3},
1277  volume = {1},
1278  journal = {AI and Ethics},
1279  author = {Petrozzino, Catherine},
1280  title = {Who pays for ethical debt in AI?},
1281}
1282
1283@article{haraway1991situated,
1284  year = {1991},
1285  pages = {183-201},
1286  journal = {Simians, cyborgs, and women: The reinvention of nature},
1287  author = {Haraway, Donna J},
1288  title = {Situated knowledges: The science question in feminism and the privilege of partial perspective},
1289}
1290
1291@book{bryan2016sentient,
1292  publisher = {Rowman \& Littlefield},
1293  year = {2016},
1294  author = {Bryan, Hilary and Burdock, Maureen and Craig, Maxine Leeds and Curtis, Jess and Dumit, Joseph and Feit, Sean and Rodr{\'\i}guez, {\'A}lvaro Iv{\'a}n Hern{\'a}ndez and Hutter, Verena and Little, Nita and Manning, Erin and others},
1295  title = {Sentient performativities of embodiment: thinking alongside the human},
1296}
1297
1298@inproceedings{mitchell2019model,
1299  year = {2019},
1300  pages = {220--229},
1301  booktitle = {conference on fairness, accountability, and transparency},
1302  author = {Mitchell, Margaret and Wu, Simone and Zaldivar, Andrew and Barnes, Parker and Vasserman, Lucy and Hutchinson, Ben and Spitzer, Elena and Raji, Inioluwa Deborah and Gebru, Timnit},
1303  title = {Model cards for model reporting},
1304}
1305
1306@article{gebru2021datasheets,
1307  publisher = {ACM New York, NY, USA},
1308  year = {2021},
1309  pages = {86--92},
1310  number = {12},
1311  volume = {64},
1312  journal = {Communications of the ACM},
1313  author = {Gebru, Timnit and Morgenstern, Jamie and Vecchione, Briana and Vaughan, Jennifer Wortman and Wallach, Hanna and Iii, Hal Daum{\'e} and Crawford, Kate},
1314  title = {Datasheets for datasets},
1315}
1316
1317@inproceedings{thomas2019migration,
1318  organization = {IEEE},
1319  year = {2019},
1320  pages = {12--17},
1321  booktitle = {2019 ACM/IEEE 14th International Conference on Global Software Engineering (ICGSE)},
1322  author = {Thomas, Suzanne L},
1323  title = {Migration versus management: the global distribution of computer vision engineering work},
1324}
1325
1326@article{nafus2014big,
1327  year = {2014},
1328  pages = {11},
1329  volume = {8},
1330  journal = {International journal of communication},
1331  author = {Nafus, Dawn and Sherman, Jamie},
1332  title = {Big data, big questions| this one does not go up to 11: the quantified self movement as an alternative big data practice},
1333}
1334
1335@article{winner1980artifacts,
1336  publisher = {JSTOR},
1337  year = {1980},
1338  pages = {121--136},
1339  journal = {Daedalus},
1340  author = {Winner, Langdon},
1341  title = {Do artifacts have politics?},
1342}
1343
1344@book{davis2020artifacts,
1345  publisher = {MIT Press},
1346  year = {2020},
1347  author = {Davis, Jenny L},
1348  title = {How artifacts afford: The power and politics of everyday things},
1349}
1350
1351@inproceedings{widder2022limits,
1352  year = {2022},
1353  booktitle = {conference on fairness, accountability, and transparency},
1354  author = {Widder, David Gray and Nafus, Dawn and Dabbish, Laura and Herbsleb, James},
1355  title = {Limits and Possibilities for “Ethical AI” in Open Source: A Study of Deepfakes},
1356}
1357
1358@article{ethicaldebt2020fiesler,
1359  year = {2020},
1360  booktitle = {Wired Ideas},
1361  author = {Fiesler, Casey and Garrett, Natalie},
1362  title = {Ethical Tech Starts with Addressing Ethical Debt},
1363}
1364
1365@incollection{dijkstra1982role,
1366  publisher = {Springer},
1367  year = {1982},
1368  pages = {60--66},
1369  booktitle = {Selected writings on computing: a personal perspective},
1370  author = {Dijkstra, Edsger W},
1371  title = {On the role of scientific thought},
1372}
1373
1374@book{cetina1999epistemic,
1375  publisher = {Harvard University Press},
1376  year = {1999},
1377  author = {Cetina, Karin Knorr},
1378  title = {Epistemic cultures: How the sciences make knowledge},
1379}
1380
1381@article{malazita2019infrastructures,
1382  publisher = {Taylor \& Francis},
1383  year = {2019},
1384  pages = {300--312},
1385  number = {4},
1386  volume = {30},
1387  journal = {Digital Creativity},
1388  author = {Malazita, James W and Resetar, Korryn},
1389  title = {Infrastructures of abstraction: how computer science education produces anti-political subjects},
1390}
1391
1392@book{latour2012we,
1393  publisher = {Harvard university press},
1394  year = {1993},
1395  author = {Latour, Bruno},
1396  title = {We have never been modern},
1397}
1398
1399@inproceedings{tarr1999n,
1400  organization = {IEEE},
1401  year = {1999},
1402  pages = {107--119},
1403  booktitle = {1999 International Conference on Software Engineering},
1404  author = {Tarr, Peri and Ossher, Harold and Harrison, William and Sutton, Stanley M},
1405  title = {N degrees of separation: Multi-dimensional separation of concerns},
1406}
1407
1408@article{zhang2021ai,
1409  year = {2021},
1410  journal = {arXiv preprint arXiv:2103.06312},
1411  author = {Zhang, Daniel and Mishra, Saurabh and Brynjolfsson, Erik and Etchemendy, John and Ganguli, Deep and Grosz, Barbara and Lyons, Terah and Manyika, James and Niebles, Juan Carlos and Sellitto, Michael and others},
1412  title = {The ai index 2021 annual report},
1413}
1414
1415@inproceedings{sirur2018we,
1416  year = {2018},
1417  pages = {88--95},
1418  booktitle = {2nd International Workshop on Multimedia Privacy and Security},
1419  author = {Sirur, Sean and Nurse, Jason RC and Webb, Helena},
1420  title = {Are we there yet? Understanding the challenges faced in complying with the General Data Protection Regulation (GDPR)},
1421}
1422
1423@book{geertz1973interpretation,
1424  publisher = {Basic books},
1425  year = {1973},
1426  volume = {5019},
1427  author = {Geertz, Clifford and others},
1428  title = {The interpretation of cultures},
1429}
1430
1431@misc{elish2020repairing,
1432  url = {https://datasociety.net/pubs/repairing-innovation.pdf},
1433  publisher = {New York: Data & Society Research Institute},
1434  year = {2020},
1435  author = {Elish, Madeleine Clare and Watkins, Elizabeth Anne},
1436  title = {Repairing Innovation: A Study of Integrating AI in Clinical Care},
1437}
1438
1439@book{scott1985weapons,
1440  publisher = {Yale University Press},
1441  year = {1985},
1442  author = {Scott, James C},
1443  title = {Weapons of the weak: Everyday forms of peasant resistance},
1444}
1445
1446@inproceedings{buolamwini2018gender,
1447  organization = {PMLR},
1448  year = {2018},
1449  pages = {77--91},
1450  booktitle = {Conference on fairness, accountability and transparency},
1451  author = {Buolamwini, Joy and Gebru, Timnit},
1452  title = {Gender shades: Intersectional accuracy disparities in commercial gender classification},
1453}
1454
1455@article{fjeld2020principled,
1456  year = {2020},
1457  number = {2020-1},
1458  journal = {Berkman Klein Center Research Publication},
1459  author = {Fjeld, Jessica and Achten, Nele and Hilligoss, Hannah and Nagy, Adam and Srikumar, Madhulika},
1460  title = {Principled artificial intelligence: Mapping consensus in ethical and rights-based approaches to principles for AI},
1461}
1462
1463@article{winecoff2022artificial,
1464  year = {2022},
1465  journal = {arXiv preprint arXiv:2203.01157},
1466  author = {Winecoff, Amy A and Watkins, Elizabeth A},
1467  title = {Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startups},
1468}
1469
1470@book{costanza2020design,
1471  publisher = {The MIT Press},
1472  year = {2020},
1473  author = {Costanza-Chock, Sasha},
1474  title = {Design justice: Community-led practices to build the worlds we need},
1475}
1476
1477@article{ottinger2022responsible,
1478  publisher = {Taylor \& Francis},
1479  year = {2022},
1480  pages = {1--19},
1481  journal = {Journal of Responsible Innovation},
1482  author = {Ottinger, Gwen},
1483  title = {Responsible epistemic innovation: How combatting epistemic injustice advances responsible innovation (and vice versa)},
1484}
1485
1486@article{lorde2003master,
1487  publisher = {Routledge New York, NY},
1488  year = {2003},
1489  pages = {27},
1490  volume = {25},
1491  journal = {Feminist postcolonial theory: A reader},
1492  author = {Lorde, Audre},
1493  title = {The master’s tools will never dismantle the master’s house},
1494}
1495
1496@book{polanyi2001great,
1497  publisher = {Beacon press},
1498  year = {2001},
1499  author = {Polanyi, Karl},
1500  title = {The great transformation: The political and economic origins of our time},
1501}
1502
1503@article{vallor2018ethics,
1504  year = {2018},
1505  journal = {The Markkula Center for Applied Ethics at Santa Clara University. https://www. scu. edu/ethics},
1506  author = {Vallor, Shannon and Green, Brian and Raicu, Irina},
1507  title = {Ethics in technology practice},
1508}
1509
1510@article{friedman1996value,
1511  publisher = {ACM New York, NY, USA},
1512  year = {1996},
1513  pages = {16--23},
1514  number = {6},
1515  volume = {3},
1516  journal = {interactions},
1517  author = {Friedman, Batya},
1518  title = {Value-sensitive design},
1519}
1520
1521@inproceedings{le2009values,
1522  year = {2009},
1523  pages = {1141--1150},
1524  booktitle = {ACM Conference On Human Factors In Computing Systems},
1525  author = {Le Dantec, Christopher A and Poole, Erika Shehan and Wyche, Susan P},
1526  title = {Values as lived experience: evolving value sensitive design in support of value discovery},
1527}
1528
1529@book{ferguson1994anti,
1530  publisher = {Minnesota Press},
1531  year = {1994},
1532  author = {Ferguson, James},
1533  title = {The anti-politics machine:" development," depoliticization, and bureaucratic power in Lesotho},
1534}
1535
1536@article{callon1998introduction,
1537  publisher = {SAGE Publications Sage UK: London, England},
1538  year = {1998},
1539  pages = {1--57},
1540  number = {1\_suppl},
1541  volume = {46},
1542  journal = {The sociological review},
1543  author = {Callon, Michel},
1544  title = {Introduction: the embeddedness of economic markets in economics},
1545}
1546
1547@book{plattner1989economic,
1548  publisher = {Stanford University Press},
1549  year = {1989},
1550  author = {Plattner, Stuart},
1551  title = {Economic anthropology},
1552}
1553
1554@misc{memic2018pesia,
1555  url = {https://blogit.itu.dk/virteuproject/2018/10/30/whats-the-pesia-framework/},
1556  publisher = {New York: Data & Society Research Institute},
1557  year = {2018},
1558  author = {Memic, Inda},
1559  title = {What's the PESIA Framework?},
1560}
1561
1562@inproceedings{gansky2022counterfacctual,
1563  year = {2022},
1564  pages = {1982--1992},
1565  booktitle = {2022 ACM Conference on Fairness, Accountability, and Transparency},
1566  author = {Gansky, Ben and McDonald, Sean},
1567  title = {CounterFAccTual: How FAccT undermines its organizing principles},
1568}
1569
1570@book{arendt1963eichmann,
1571  publisher = {Viking Press},
1572  year = {1963},
1573  author = {Arendt, Hannah},
1574  title = {Eichmann in Jerusalem: A report on the banality of evil},
1575}
1576
1577@article{chmielinski2022dataset,
1578  year = {2022},
1579  journal = {arXiv preprint arXiv:2201.03954},
1580  author = {Chmielinski, Kasia S and Newman, Sarah and Taylor, Matt and Joseph, Josh and Thomas, Kemi and Yurkofsky, Jessica and Qiu, Yue Chelsea},
1581  title = {The dataset nutrition label (2nd Gen): Leveraging context to mitigate harms in artificial intelligence},
1582}
1583
1584@article{strathern2002anthropological,
1585  publisher = {Oxford University Press on Demand},
1586  year = {2002},
1587  pages = {302},
1588  journal = {Virtual society?: Technology, cyberbole, reality},
1589  author = {Strathern, Marilyn},
1590  title = {An anthropological comment},
1591}
1592
1593@article{grant1991friedman,
1594  publisher = {Springer},
1595  year = {1991},
1596  pages = {907--914},
1597  number = {12},
1598  volume = {10},
1599  journal = {Journal of Business Ethics},
1600  author = {Grant, Colin},
1601  title = {Friedman fallacies},
1602}
1603
1604@inproceedings{lee2015working,
1605  year = {2015},
1606  pages = {1603--1612},
1607  booktitle = {onference on human factors in computing systems},
1608  author = {Lee, Min Kyung and Kusbit, Daniel and Metsky, Evan and Dabbish, Laura},
1609  title = {Working with machines: The impact of algorithmic and data-driven management on human workers},
1610}
1611
1612@misc{isaac_hao_2022,
1613  howpublished = {\url{https://www.youtube.com/watch?v=9u-62Ijtb1I}},
1614  month = {Jun},
1615  year = {2022},
1616  author = {Isaac, William and Hao, Karen},
1617  journal = { ACM Conference on Fairness, Accountability and Transparency},
1618  title = {Keynote Interview: Karen Hao in Conversation with William Isaac},
1619}
1620
1621@book{goffman1959presentation,
1622  publisher = {Anchor},
1623  year = {1959},
1624  author = {Goffman, Erving},
1625  title = {The presentation of self in everyday life},
1626}
1627
1628@article{gebru2022slowAI,
1629  year = {2022},
1630  month = {March},
1631  day = {31},
1632  author = {Strickland ,Eliza},
1633  journal = {IEEE Spectrum},
1634  note = {Accessed: 2022-07-7},
1635  howpublished = {\url{https://spectrum.ieee.org/timnit-gebru-dair-ai-ethics}},
1636  title = {Timnit Gebru Is Building a Slow AI Movement},
1637}
1638
1639@inproceedings{bender2021dangers,
1640  year = {2021},
1641  pages = {610--623},
1642  booktitle = {Conference on Fairness, Accountability, and Transparency},
1643  author = {Bender, Emily M and Gebru, Timnit and McMillan-Major, Angelina and Shmitchell, Shmargaret},
1644  title = {On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?},
1645}
1646
1647@article{wang2019federated,
1648  year = {2019},
1649  journal = {arXiv preprint arXiv:1910.10252},
1650  author = {Wang, Kangkang and Mathews, Rajiv and Kiddon, Chlo{\'e} and Eichner, Hubert and Beaufays, Fran{\c{c}}oise and Ramage, Daniel},
1651  title = {Federated evaluation of on-device personalization},
1652}
1653
1654@article{feller2006value,
1655  year = {2006},
1656  pages = {1--7},
1657  volume = {1},
1658  journal = {BP trends},
1659  author = {Feller, Andrew and Shunk, Dan and Callarman, Tom},
1660  title = {Value chains versus supply chains},
1661}
1662
1663@misc{dobbe2022safety,
1664  copyright = {arXiv.org perpetual, non-exclusive license},
1665  year = {2022},
1666  publisher = {arXiv},
1667  title = {System Safety and Artificial Intelligence},
1668  keywords = {Systems and Control (eess.SY), Artificial Intelligence (cs.AI), Computers and Society (cs.CY), Machine Learning (cs.LG), Software Engineering (cs.SE), FOS: Electrical engineering, electronic engineering, information engineering, FOS: Electrical engineering, electronic engineering, information engineering, FOS: Computer and information sciences, FOS: Computer and information sciences},
1669  author = {Dobbe, Roel I. J.},
1670  url = {https://arxiv.org/abs/2202.09292},
1671  doi = {10.48550/ARXIV.2202.09292},
1672}
1673
1674@inproceedings{shaw2011modularity,
1675  year = {2011},
1676  pages = {1--6},
1677  booktitle = {international conference on Aspect-oriented software development},
1678  author = {Shaw, Mary},
1679  title = {Modularity for the modern world: summary of invited keynote},
1680}
1681
1682@book{baldwin2000design,
1683  publisher = {MIT press},
1684  year = {2000},
1685  volume = {1},
1686  author = {Baldwin, Carliss Young and Clark, Kim B and Clark, Kim B and others},
1687  title = {Design rules: The power of modularity},
1688}
1689
1690@inproceedings{martini2016estimating,
1691  organization = {IEEE},
1692  year = {2016},
1693  pages = {92--99},
1694  booktitle = {2016 42th Euromicro conference on software engineering and advanced applications (SEAA)},
1695  author = {Martini, Antonio and Sikander, Erik and Medlani, Niel},
1696  title = {Estimating and quantifying the benefits of refactoring to improve a component modularity: a case study},
1697}
1698
1699@article{maccormack_exploring_2006,
1700  file = {MacCormack et al. - 2006 - Exploring the Structure of Complex Software Design.pdf:/Users/dwidder/Zotero/storage/S5WG9UDD/MacCormack et al. - 2006 - Exploring the Structure of Complex Software Design.pdf:application/pdf},
1701  pages = {1015--1030},
1702  year = {2006},
1703  month = {July},
1704  author = {MacCormack, Alan and Rusnak, John and Baldwin, Carliss Y.},
1705  journal = {Management Science},
1706  urldate = {2022-08-05},
1707  number = {7},
1708  language = {en},
1709  abstract = {This paper reports data from a study that seeks to characterize the differences in design structure between complex software products. We use design structure matrices (DSMs) to map dependencies between the elements of a design and define metrics that allow us to compare the structures of different designs. We use these metrics to compare the architectures of two software products—the Linux operating system and the Mozilla Web browser—that were developed via contrasting modes of organization: specifically, open source versus proprietary development. We then track the evolution of Mozilla, paying attention to a purposeful “redesign” effort undertaken with the intention of making the product more “modular.” We find significant differences in structure between Linux and the first version of Mozilla, suggesting that Linux had a more modular architecture. Yet we also find that the redesign of Mozilla resulted in an architecture that was significantly more modular than that of its predecessor and, indeed, than that of Linux. Our results, while exploratory, are consistent with a view that different modes of organization are associated with designs that possess different structures. However, they also suggest that purposeful managerial actions can have a significant impact in adapting a design’s structure. This latter result is important given recent moves to release proprietary software into the public domain. These moves are likely to fail unless the product possesses an “architecture for participation.”},
1710  doi = {10.1287/mnsc.1060.0552},
1711  url = {http://pubsonline.informs.org/doi/10.1287/mnsc.1060.0552},
1712  shorttitle = {Exploring the {Structure} of {Complex} {Software} {Designs}},
1713  issn = {0025-1909, 1526-5501},
1714  volume = {52},
1715  title = {Exploring the {Structure} of {Complex} {Software} {Designs}: {An} {Empirical} {Study} of {Open} {Source} and {Proprietary} {Code}},
1716}
1717
1718@article{vessey1983some,
1719  publisher = {ACM New York, NY, USA},
1720  year = {1983},
1721  pages = {128--134},
1722  number = {2},
1723  volume = {26},
1724  journal = {Communications of the ACM},
1725  author = {Vessey, Iris and Weber, Ron},
1726  title = {Some factors affecting program repair maintenance: an empirical study},
1727}
1728
1729@article{shen1985identifying,
1730  publisher = {IEEE},
1731  year = {1985},
1732  pages = {317--324},
1733  number = {4},
1734  journal = {IEEE Transactions on Software Engineering},
1735  author = {Shen, Vincent Yun and Yu, Tze-jie and Thebaut, Stephen M. and Paulsen, Lorri R.},
1736  title = {Identifying error-prone software—an empirical study},
1737}
1738
1739@article{kim2014empirical,
1740  publisher = {IEEE},
1741  year = {2014},
1742  pages = {633--649},
1743  number = {7},
1744  volume = {40},
1745  journal = {IEEE Transactions on Software Engineering},
1746  author = {Kim, Miryung and Zimmermann, Thomas and Nagappan, Nachiappan},
1747  title = {An empirical study of refactoringchallenges and benefits at microsoft},
1748}
1749
1750@article{basili1984software,
1751  publisher = {ACM New York, NY, USA},
1752  year = {1984},
1753  pages = {42--52},
1754  number = {1},
1755  volume = {27},
1756  journal = {Communications of the ACM},
1757  author = {Basili, Victor R and Perricone, Barry T},
1758  title = {Software errors and complexity: an empirical investigation0},
1759}
1760
1761@article{kemerer1995software,
1762  publisher = {Springer},
1763  year = {1995},
1764  pages = {1--22},
1765  number = {1},
1766  volume = {1},
1767  journal = {Annals of Software Engineering},
1768  author = {Kemerer, Chris F},
1769  title = {Software complexity and software maintenance: A survey of empirical research},
1770}
1771
1772@inproceedings{kastner2011road,
1773  year = {2011},
1774  pages = {1--8},
1775  booktitle = {15th International Software Product Line Conference, Volume 2},
1776  author = {K{\"a}stner, Christian and Apel, Sven and Ostermann, Klaus},
1777  title = {The road to feature modularity?},
1778}
1779
1780@article{troy1981measuring,
1781  publisher = {Elsevier},
1782  year = {1981},
1783  pages = {113--120},
1784  number = {2},
1785  volume = {2},
1786  journal = {Journal of Systems and Software},
1787  author = {Troy, Douglas A and Zweben, Stuart H},
1788  title = {Measuring the quality of structured designs},
1789}
1790
1791@inproceedings{korson1986modularity,
1792  organization = {Intellect L \& DEFAE},
1793  year = {1986},
1794  pages = {168},
1795  volume = {1},
1796  booktitle = {Empirical Studies of Programmers: Papers Presented at the First Workshop on Empirical Studies of Programmers, June 5-6, 1986, Washington, DC},
1797  author = {Korson, Timothy D and Vaishnavi, Vijay K},
1798  title = {Modularity on Program Modifiability},
1799}
1800
1801@article{yeung2019ai,
1802  year = {2019},
1803  journal = {The Oxford Handbook of AI Ethics, Oxford University Press (2019)},
1804  author = {Yeung, Karen and Howes, Andrew and Pogrebna, Ganna},
1805  title = {AI governance by human rights-centred design, deliberation and oversight: An end to ethics washing},
1806}
1807
1808@inproceedings{javadi2021monitoring,
1809  year = {2021},
1810  pages = {597--607},
1811  booktitle = {AAAI/Conference on AI, Ethics, and Society},
1812  author = {Javadi, Seyyed Ahmad and Norval, Chris and Cloete, Richard and Singh, Jatinder},
1813  title = {Monitoring AI Services for Misuse},
1814}
1815
1816@article{madaio2022assessing,
1817  publisher = {ACM New York, NY, USA},
1818  year = {2022},
1819  pages = {1--26},
1820  number = {CSCW1},
1821  volume = {6},
1822  journal = {Conference On Computer-Supported Cooperative Work And Social Computing},
1823  author = {Madaio, Michael and Egede, Lisa and Subramonyam, Hariharan and Wortman Vaughan, Jennifer and Wallach, Hanna},
1824  title = {Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support},
1825}
1826
1827@article{piorkowski2021ai,
1828  publisher = {ACM New York, NY, USA},
1829  year = {2021},
1830  pages = {1--25},
1831  number = {CSCW1},
1832  volume = {5},
1833  journal = {Conference On Computer-Supported Cooperative Work And Social Computing},
1834  author = {Piorkowski, David and Park, Soya and Wang, April Yi and Wang, Dakuo and Muller, Michael and Portnoy, Felix},
1835  title = {How ai developers overcome communication challenges in a multidisciplinary team: A case study},
1836}
1837
1838@inproceedings{subramonyam2022solving,
1839  year = {2022},
1840  pages = {1--21},
1841  booktitle = {ACM Conference On Human Factors In Computing Systems},
1842  author = {Subramonyam, Hariharan and Im, Jane and Seifert, Colleen and Adar, Eytan},
1843  title = {Solving Separation-of-Concerns Problems in Collaborative Design of Human-AI Systems through Leaky Abstractions},
1844}
1845
1846@article{rakova_where_2021,
1847  file = {Rakova et al. - 2021 - Where Responsible AI meets Reality Practitioner P.pdf:/Users/dwidder/Zotero/storage/W8M7SHV4/Rakova et al. - 2021 - Where Responsible AI meets Reality Practitioner P.pdf:application/pdf},
1848  pages = {1--23},
1849  year = {2021},
1850  month = {April},
1851  author = {Rakova, Bogdana and Yang, Jingying and Cramer, Henriette and Chowdhury, Rumman},
1852  journal = {on Human-Computer Interaction},
1853  urldate = {2022-08-05},
1854  number = {CSCW1},
1855  language = {en},
1856  abstract = {Large and ever-evolving technology companies continue to invest more time and resources to incorporate responsible Artificial Intelligence (AI) into production-ready systems to increase algorithmic accountability. This paper examines and seeks to offer a framework for analyzing how organizational culture and structure impact the effectiveness of responsible AI initiatives in practice. We present the results of semi-structured qualitative interviews with practitioners working in industry, investigating common challenges, ethical tensions, and effective enablers for responsible AI initiatives. Focusing on major companies developing or utilizing AI, we have mapped what organizational structures currently support or hinder responsible AI initiatives, what aspirational future processes and structures would best enable effective initiatives, and what key elements comprise the transition from current work practices to the aspirational future.},
1857  doi = {10.1145/3449081},
1858  url = {https://dl.acm.org/doi/10.1145/3449081},
1859  shorttitle = {Where {Responsible} {AI} meets {Reality}},
1860  issn = {2573-0142},
1861  volume = {5},
1862  title = {Where {Responsible} {AI} meets {Reality}: {Practitioner} {Perspectives} on {Enablers} for {Shifting} {Organizational} {Practices}},
1863}
1864
1865@inproceedings{hong2021planning,
1866  file = {/Users/dwidder/Zotero/storage/VAVH5E5E/Hong et al. - 2021 - Planning for Natural Language Failures with the AI.pdf},
1867  keywords = {madaio recomended},
1868  langid = {english},
1869  isbn = {978-1-4503-8096-6},
1870  abstract = {Prototyping AI user experiences is challenging due in part to probabilistic AI models making it difcult to anticipate, test, and mitigate AI failures before deployment. In this work, we set out to support practitioners with early AI prototyping, with a focus on natural language (NL)-based technologies. Our interviews with 12 NL practitioners from a large technology company revealed that, in addition to challenges prototyping AI, prototyping was often not happening at all or focused only on idealized scenarios due to a lack of tools and tight timelines. These fndings informed our design of the AI Playbook, an interactive and low-cost tool we developed to encourage proactive and systematic consideration of AI errors before deployment. Our evaluation of the AI Playbook demonstrates its potential to 1) encourage product teams to prioritize both ideal and failure scenarios, 2) standardize the articulation of AI failures from a user experience perspective, and 3) act as a boundary object between user experience designers, data scientists, and engineers.},
1871  doi = {10.1145/3411764.3445735},
1872  address = {{Yokohama Japan}},
1873  publisher = {{ACM}},
1874  pages = {1--11},
1875  month = {May},
1876  year = {2021},
1877  author = {Hong, Matthew K. and Fourney, Adam and DeBellis, Derek and Amershi, Saleema},
1878  booktitle = {Conference Human Factors in Computing Systems},
1879  title = {Planning for {{Natural Language Failures}} with the {{AI Playbook}}},
1880}
1881
1882@inproceedings{bennett2019promise,
1883  file = {/Users/dwidder/Zotero/storage/59REB23M/Bennett and Rosner - 2019 - The Promise of Empathy Design, Disability, and Kn.pdf},
1884  langid = {english},
1885  isbn = {978-1-4503-5970-2},
1886  abstract = {This paper examines the promise of empathy, the name commonly given to the initial phase of the human-centered design process in which designers seek to understand their intended users in order to inform technology development. By analyzing popular empathy activities aimed at understanding people with disabilities, we examine the ways empathy works to both powerfully and problematically align designers with the values of people who may use their products. Drawing on disability studies and feminist theorizing, we describe how acts of empathy building may further distance people with disabilities from the processes designers intend to draw them into. We end by reimagining empathy as guided by the lived experiences of people with disabilities who are traditionally positioned as those to be empathized.},
1887  doi = {10.1145/3290605.3300528},
1888  address = {{Glasgow Scotland Uk}},
1889  publisher = {{ACM}},
1890  pages = {1--13},
1891  month = {May},
1892  year = {2019},
1893  author = {Bennett, Cynthia L. and Rosner, Daniela K.},
1894  booktitle = {{{Conference}} on {{Human Factors}} in {{Computing Systems}}},
1895  shorttitle = {The {{Promise}} of {{Empathy}}},
1896  title = {The {{Promise}} of {{Empathy}}: {{Design}}, {{Disability}}, and {{Knowing}} the "{{Other}}"},
1897}
1898
1899@book{latour1999pandora,
1900  publisher = {Harvard university press},
1901  year = {1999},
1902  author = {Latour, Bruno and others},
1903  title = {Pandora's hope: essays on the reality of science studies},
1904}
1905
1906@incollection{liboiron2021pollution,
1907  publisher = {Duke University Press},
1908  year = {2021},
1909  booktitle = {Pollution Is Colonialism},
1910  author = {Liboiron, Max},
1911  title = {Pollution is colonialism},
1912}
1913
1914@inproceedings{dix2007designing,
1915  file = {/Users/dwidder/Zotero/storage/3BE34IZI/Dix - 2007 - Designing for appropriation.pdf},
1916  keywords = {appropriation,guidelines,hackability,tailorability},
1917  isbn = {978-1-902505-95-4},
1918  abstract = {Ethnographies often show that users appropriate and adapt technology in ways never envisaged by the designers, or even deliberately subverting the designers' intentions. As design can never be complete, such appropriation is regarded as an important and positive phenomenon. However designing for appropriation is often seen as an oxymoron; it appears impossible to design for the unexpected. In this paper we present some guidelines for appropriation based on our own experience and published literature and demonstrate their use in two case studies. You may not be able to design for the unexpected, but you can design to allow the unexpected.},
1919  address = {{Swindon, GBR}},
1920  publisher = {{BCS Learning \& Development Ltd.}},
1921  pages = {27--30},
1922  series = {{{BCS-HCI}} '07},
1923  month = {September},
1924  year = {2007},
1925  author = {Dix, Alan},
1926  booktitle = {21st {{British HCI Group Annual Conference}} on {{People}} and {{Computers}}: {{HCI}}...but Not as We Know It - {{Volume}} 2},
1927  title = {Designing for Appropriation},
1928}
1929
1930@article{nissenbaum1996accountability,
1931  file = {/Users/dwidder/Zotero/storage/K64IKDF2/Nissenbaum - 1996 - Accountability in a computerized society.pdf},
1932  keywords = {accountability,bugs,computer ethics,liability,moral responsibility,standard of care},
1933  langid = {english},
1934  abstract = {This essay warns of eroding accountability in computerized societies. It argues that assumptions about computing and features of situations in which computers are produced create barriers to accountability. Drawing on philosophical analyses of moral blame and responsibility, four barriers are identified: 1) the problem of many hands, 2) the problem of bugs, 3) blaming the computer, and 4) software ownership without liability. The paper concludes with ideas on how to reverse this trend.},
1935  doi = {10.1007/BF02639315},
1936  issn = {1471-5546},
1937  pages = {25--42},
1938  number = {1},
1939  volume = {2},
1940  journal = {Science and Engineering Ethics},
1941  month = {March},
1942  year = {1996},
1943  author = {Nissenbaum, Helen},
1944  title = {Accountability in a Computerized Society},
1945}
1946
1947@misc{hanna2020scale,
1948  file = {/Users/dwidder/Zotero/storage/AU4GCCEJ/Hanna and Park - 2020 - Against Scale Provocations and Resistances to Sca.pdf;/Users/dwidder/Zotero/storage/T5BVHY2H/2010.html},
1949  keywords = {Computer Science - Computers and Society},
1950  archiveprefix = {arXiv},
1951  abstract = {At the heart of what drives the bulk of innovation and activity in Silicon Valley and elsewhere is scalability. This unwavering commitment to scalability -- to identify strategies for efficient growth -- is at the heart of what we refer to as "scale thinking." Whether people are aware of it or not, scale thinking is all-encompassing. It is not just an attribute of one's product, service, or company, but frames how one thinks about the world (what constitutes it and how it can be observed and measured), its problems (what is a problem worth solving versus not), and the possible technological fixes for those problems. This paper examines different facets of scale thinking and its implication on how we view technology and collaborative work. We argue that technological solutions grounded in scale thinking are unlikely to be as liberatory or effective at deep, systemic change as their purveyors imagine. Rather, solutions which resist scale thinking are necessary to undo the social structures which lie at the heart of social inequality. We draw on recent work on mutual aid networks and propose questions to ask of collaborative work systems as a means to evaluate technological solutions and guide designers in identifying sites of resistance to scale thinking.},
1952  institution = {{arXiv}},
1953  primaryclass = {cs},
1954  eprinttype = {arxiv},
1955  eprint = {2010.08850},
1956  number = {arXiv:2010.08850},
1957  month = {November},
1958  year = {2020},
1959  author = {Hanna, Alex and Park, Tina M.},
1960  shorttitle = {Against {{Scale}}},
1961  title = {Against {{Scale}}: {{Provocations}} and {{Resistances}} to {{Scale Thinking}}},
1962}
1963
1964@article{horwitz2021facebook,
1965  file = {/Users/dwidder/Zotero/storage/D23QHZXH/the-facebook-files-11631713039.html},
1966  keywords = {entertainment,Facebook,FB,graphics,GRAPHICS,Mark Zuckerberg,media,Media/Entertainment,online service providers,Online Service Providers,social media platforms,Social Media Platforms/Tools,SYND,technology,Technology,tools,WSJ-PRO-WSJ.com},
1967  langid = {american},
1968  chapter = {Tech},
1969  abstract = {Facebook knows, in acute detail, that its platforms are riddled with flaws but hasn't fixed them. That's a key finding of a Journal series that launched this week, based on an array of internal company documents. Read all the stories here.},
1970  issn = {0099-9660},
1971  journal = {Wall Street Journal},
1972  month = {October},
1973  year = {2021},
1974  author = {Horwitz, Jeff and others},
1975  title = {The {{Facebook Files}}},
1976}
1977
1978@incollection{agre1997lessons,
1979  year = {1997},
1980  publisher = {Lawrence Erlbaum Associates, Inc.},
1981  booktitle = {Social science, technical systems, and cooperative work: Beyond the Great Divide},
1982  editor = {Bowker, G and Star,  L and Turner,  B and Gasser, L},
1983  author = {Agre, Philip E},
1984  title = {Bridging the Great Divide: Social Science, Technical Systems, and Cooperative Work},
1985}
1986
1987@article{hockenberry2021redirected,
1988  publisher = {Taylor \& Francis},
1989  year = {2021},
1990  pages = {641--662},
1991  number = {4-5},
1992  volume = {35},
1993  journal = {Cultural studies},
1994  author = {Hockenberry, Matthew},
1995  title = {Redirected entanglements in the digital supply chain},
1996}
1997
1998@inbook{gurses2018agile,
1999  collection = {Cambridge Law Handbooks},
2000  pages = {579–601},
2001  year = {2018},
2002  editor = {Selinger, Evan and Polonetsky, Jules and Tene, OmerEditors},
2003  author = {Gürses, Seda and van Hoboken, Joris},
2004  publisher = {Cambridge},
2005  booktitle = {The Cambridge Handbook of Consumer Privacy},
2006  doi = {10.1017/9781316831960.032},
2007  title = {Privacy after the Agile Turn},
2008  series = {Cambridge Law Handbooks},
2009  place = {Cambridge},
2010}
2011
2012@article{carroll2020care,
2013  year = {2020},
2014  author = {Carroll, Stephanie Russo and Garba, Ibrahim and Figueroa-Rodr{\'\i}guez, Oscar L and Holbrook, Jarita and Lovett, Raymond and Materechera, Simeon and Parsons, Mark and Raseroka, Kay and Rodriguez-Lonebear, Desi and Rowe, Robyn and others},
2015  title = {The CARE principles for indigenous data governance.},
2016}
2017
2018@article{posner2018see,
2019  journal = {Logic Magazine},
2020  year = {2018},
2021  author = {Posner, Miriam},
2022  title = {See no evil},
2023}
2024
2025@article{widder2022dislocateda,
2026  file = {/Users/dwidder/Zotero/storage/MPIM24UX/Widder and Nafus - 2022 - Dislocated Accountabilities in the AI Supply Chain.pdf},
2027  langid = {english},
2028  abstract = {Responsible AI guidelines often ask engineers to consider how their systems might harm. However, contemporary AI systems are built by composing many preexisting software modules that pass through many hands before becoming a finished product or service. How does this shape responsible AI practice? In interviews with 27 AI engineers across industry, open source, and academia, our participants often did not see the questions posed in responsible AI guidelines to be within their agency, capability, or responsibility to address. We use Lucy Suchman's notion of located accountability to show how responsible AI labor is currently organized, and to explore how it could be done differently. We identify cross-cutting social logics, like modularizability, scale, reputation, and customer orientation, that organize which responsible AI actions do take place, and which are relegated to low status staff or believed to be the work of the next or previous person in the chain. We argue that current responsible AI interventions, like ethics checklists and guidelines that assume panoptical knowledge and control over systems, could improve by taking a located accountability approach, where relations and obligations intertwine and incrementally add value in the process. This would constitute a shift from "supply chain' thinking to "value chain" thinking.},
2029  doi = {10.48550/arXiv.2209.09780},
2030  month = {September},
2031  year = {2022},
2032  author = {Widder, David Gray and Nafus, Dawn},
2033  shorttitle = {Dislocated {{Accountabilities}} in the {{AI Supply Chain}}},
2034  title = {Dislocated {{Accountabilities}} in the {{AI Supply Chain}}: {{Modularity}} and {{Developers}}' {{Notions}} of {{Responsibility}}},
2035}
2036
2037@article{doorey2011transparent,
2038  file = {/Users/dwidder/Zotero/storage/GHBQQXIA/Doorey - 2011 - The Transparent Supply Chain from Resistance to I.pdf},
2039  langid = {english},
2040  abstract = {Information disclosure is a common regulatory tool designed to influence business behavior. A belief is that transparency can provoke learning and also positive institutional change by empowering private watchdogs to monitor and pressure business leaders to alter harmful behavior. Beginning in the late 1990s, a private movement emerged that pressured corporations to disclose the identify of their global supplier factories. These activists believed that factory disclosure would lead to greater accountability by corporations for the working conditions under which their products are made, which in time would improve labor practices. In 1995, Nike and Levi-Strauss (Levis) surprised the business community by publishing their supplier lists. This paper describes case studies of Nike and Levis, tracking the evolution from resistance to supply chain transparency through to the decision to be industry leaders in factory disclosure. The paper evaluates the contribution of factory disclosure and proposes that other companies should be urged to move toward supply chain transparency.},
2041  doi = {10.1007/s10551-011-0882-1},
2042  issn = {0167-4544, 1573-0697},
2043  pages = {587--603},
2044  number = {4},
2045  volume = {103},
2046  journal = {Journal of Business Ethics},
2047  month = {November},
2048  year = {2011},
2049  author = {Doorey, David J.},
2050  shorttitle = {The {{Transparent Supply Chain}}},
2051  title = {The {{Transparent Supply Chain}}: From {{Resistance}} to {{Implementation}} at {{Nike}} and {{Levi-Strauss}}},
2052}
2053
2054@misc{2023exclusive,
2055  file = {/Users/dwidder/Zotero/storage/PXASVVA5/openai-chatgpt-kenya-workers.html},
2056  langid = {english},
2057  howpublished = {https://time.com/6247678/openai-chatgpt-kenya-workers/},
2058  abstract = {A TIME investigation reveals the difficult conditions faced by the workers who made ChatGPT possible},
2059  journal = {Time},
2060  month = {January},
2061  year = {2023},
2062  shorttitle = {Exclusive},
2063  title = {Exclusive: {{The}} \$2 {{Per Hour Workers Who Made ChatGPT Safer}}},
2064}
2065
2066@article{fukuda-parr2021emerging,
2067  file = {/Users/dwidder/Zotero/storage/E4CIYKC9/Fukuda-Parr and Gibbons - 2021 - Emerging Consensus on ‘Ethical AI’ Human Rights C.pdf;/Users/dwidder/Zotero/storage/CHIUVNKP/1758-5899.html},
2068  annotation = {\_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/1758-5899.12965},
2069  langid = {english},
2070  abstract = {Voluntary guidelines on `ethical practices' have been the response by stakeholders to address the growing concern over harmful social consequences of artificial intelligence and digital technologies. Issued by dozens of actors from industry, government and professional associations, the guidelines are creating a consensus on core standards and principles for ethical design, development and deployment of artificial intelligence (AI). Using human rights principles (equality, participation and accountability) and attention to the right to privacy, this paper reviews 15 guidelines preselected to be strongest on human rights, and on global health. We find about half of these ground their guidelines in international human rights law and incorporate the key principles; even these could go further, especially in suggesting ways to operationalize them. Those that adopt the ethics framework are particularly weak in laying out standards for accountability, often focusing on `transparency', and remaining silent on enforceability and participation which would effectively protect the social good. These guidelines mention human rights as a rhetorical device to obscure the absence of enforceable standards and accountability measures, and give their attention to the single right to privacy. These `ethics' guidelines, disproportionately from corporations and other interest groups, are also weak on addressing inequalities and discrimination. We argue that voluntary guidelines are creating a set of de facto norms and re-interpretation of the term `human rights' for what would be considered `ethical' practice in the field. This exposes an urgent need for action by governments and civil society to develop more rigorous standards and regulatory measures, grounded in international human rights frameworks, capable of holding Big Tech and other powerful actors to account.},
2071  doi = {10.1111/1758-5899.12965},
2072  issn = {1758-5899},
2073  pages = {32--44},
2074  number = {S6},
2075  volume = {12},
2076  journal = {Global Policy},
2077  year = {2021},
2078  author = {{Fukuda-Parr}, Sakiko and Gibbons, Elizabeth},
2079  shorttitle = {Emerging {{Consensus}} on `{{Ethical AI}}'},
2080  title = {Emerging {{Consensus}} on `{{Ethical AI}}': {{Human Rights Critique}} of {{Stakeholder Guidelines}}},
2081}
2082
2083@article{kriebitz2020xinjiang,
2084  file = {/Users/dwidder/Zotero/storage/GP2ZZV65/Kriebitz and Max - 2020 - The Xinjiang Case and Its Implications from a Busi.pdf},
2085  keywords = {China,Digitization,Human rights,Xinjiang},
2086  langid = {english},
2087  abstract = {The discourse on economic integration with authoritarian regimes has evolved as a key topic throughout the different disciplines of social sciences. Are sanctions and boycotts effective methods to incentivize human rights improvements? To analyze this question, we focus on the situation in China's Xinjiang province from 2010 to 2019. In this paper, we discuss the relevance of human rights as an ethical norm within business ethics and international law. We evaluate the ongoing processes in Xinjiang from this perspective and scrutinize the interests of major players in the region, including the Central Government of the People's Republic of China, Xinjiang's local government, and enterprises involved in the region. Following this, we discuss which economic measures will improve the human rights situation and how these measures contribute to an improvement of the situation.},
2088  doi = {10.1007/s12142-020-00591-0},
2089  issn = {1874-6306},
2090  pages = {243--265},
2091  number = {3},
2092  volume = {21},
2093  journal = {Human Rights Review},
2094  month = {September},
2095  year = {2020},
2096  author = {Kriebitz, Alexander and Max, Raphael},
2097  title = {The {{Xinjiang Case}} and {{Its Implications}} from a {{Business Ethics Perspective}}},
2098}
2099
2100@article{flacks2022uyghur,
2101  file = {/Users/dwidder/Zotero/storage/4C5F7TIB/uyghur-forced-labor-prevention-act-goes-effect.html},
2102  langid = {english},
2103  abstract = {The Uyghur Forced Labor Prevention Act creates a presumption that no goods from Xinjiang can be imported into the United States due to the use of forced labor. Read what this means for U.S. importers and supply chains, and how it could impact human rights in the region.},
2104  year = {Mon, 06/27/2022 - 12:00},
2105  author = {Flacks, \hspace{0pt}Marti and Songy, Madeleine},
2106  title = {The {{Uyghur Forced Labor Prevention Act Goes}} into {{Effect}}},
2107}
2108
2109@article{mulligan2019procurement,
2110  publisher = {HeinOnline},
2111  year = {2019},
2112  pages = {773},
2113  volume = {34},
2114  journal = {Berkeley Tech. LJ},
2115  author = {Mulligan, Deirdre K and Bamberger, Kenneth A},
2116  title = {Procurement as policy: Administrative process for machine learning},
2117}
2118
2119@inproceedings{wong2019bringing,
2120  file = {Attachment:C\:\\Users\\rwong34\\Zotero\\storage\\5U4VE2RS\\Wong, Mulligan - 2019 - Bringing Design to the Privacy Table Broadening Design in Privacy by Design Through the Lens of HCI.pdf:application/pdf;PDF:C\:\\Users\\rwong34\\Zotero\\storage\\442IMFBC\\Wong, Mulligan - 2019 - Bringing Design to the Privacy Table Broadening Design in Privacy by Design Through the Lens of HCI.pdf:application/pdf},
2121  keywords = {2019, acm reference format, bringing design, design approaches, Design approaches, design research, Design research, mulligan, privacy by design, Privacy by design, richmond y, wong and deirdre k},
2122  year = {2019},
2123  author = {Wong, Richmond Y. and Mulligan, Deirdre K.},
2124  booktitle = {{CHI} {Conference} on {Human} {Factors} in {Computing} {Systems} ({CHI} 2019)},
2125  abstract = {In calls for privacy by design (PBD), regulators and privacy scholars have investigated the richness of the concept of "privacy." In contrast, "design" in HCI is comprised of rich and complex concepts and practices, but has received much less attention in the PBD context. Conducting a literature review of HCI publications discussing privacy and design, this paper articulates a set of dimensions along which design relates to privacy, including: the purpose of design, which actors do design work in these settings, and the envisioned beneficiaries of design work. We suggest new roles for HCI and design in PBD research and practice: utilizing values- and critically-oriented design approaches to foreground social values and help define privacy problem spaces. We argue such approaches, in addition to current "design to solve privacy problems" efforts, are essential to the full realization of PBD, while noting the politics involved when choosing design to address privacy.},
2126  doi = {10.1145/3290605.3300492},
2127  isbn = {978-1-4503-5970-2},
2128  title = {Bringing {Design} to the {Privacy} {Table}: {Broadening} "{Design}" in "{Privacy} by {Design}" {Through} the {Lens} of {HCI}},
2129}
2130
2131@misc{fiesler_black_2018,
2132  year = {2018},
2133  author = {Fiesler, Casey},
2134  journal = {How we get to Next},
2135  urldate = {2021-06-09},
2136  url = {https://howwegettonext.com/the-black-mirror-writers-room-teaching-technology-ethics-through-speculation-f1a9e2deccf4},
2137  title = {Black {Mirror}, {Light} {Mirror}: {Teaching} {Technology} {Ethics} {Through} {Speculation}},
2138}
2139
2140@inproceedings{ballard_judgment_2019,
2141  file = {Attachment:C\:\\Users\\rwong34\\Zotero\\storage\\KSRPX3B3\\Ballard, Chappell, Kennedy - 2019 - Judgment Call the Game.pdf:application/pdf;PDF:C\:\\Users\\rwong34\\Zotero\\storage\\XXW768QK\\Ballard, Chappell, Kennedy (2019) Judgement call the game - using value sensitive design and design fiction to surface ethical concerns related to technology.pdf:application/pdf},
2142  pages = {421--433},
2143  year = {2019},
2144  author = {Ballard, Stephanie and Chappell, Karen M. and Kennedy, Kristen},
2145  publisher = {ACM Press},
2146  booktitle = {Proceedings of the 2019 on {Designing} {Interactive} {Systems} {Conference} - {DIS} '19},
2147  doi = {10.1145/3322276.3323697},
2148  url = {http://dl.acm.org/citation.cfm?doid=3322276.3323697},
2149  isbn = {978-1-4503-5850-7},
2150  title = {Judgment {Call} the {Game}: {Using} value sensitive design and design fiction to surface ethical concerns related to technology},
2151  address = {New York, New York, USA},
2152}
2153
2154@article{shilton_values_2013,
2155  file = {Attachment:C\:\\Users\\rwong34\\Zotero\\storage\\83AR7SVG\\Shilton - 2013 - Values Levers Building Ethics into Design.pdf:application/pdf;PDF:C\:\\Users\\rwong34\\Zotero\\storage\\XK5FZ6PH\\Shilton (2012) Values Levers- Building Ethics into Design.pdf:application/pdf},
2156  pages = {374--397},
2157  keywords = {dissertation, value centered design},
2158  year = {2013},
2159  author = {Shilton, Katie},
2160  journal = {Science, Technology, \& Human Values},
2161  number = {3},
2162  doi = {10.1177/0162243912436985},
2163  url = {http://journals.sagepub.com/doi/10.1177/0162243912436985},
2164  issn = {0162-2439},
2165  volume = {38},
2166  title = {Values {Levers}: {Building} {Ethics} into {Design}},
2167}
2168
2169@inproceedings{Wong2021timelines,
2170  file = {PDF:C\:\\Users\\rwong34\\Zotero\\storage\\ME9CN5BG\\CHI_2021___Timelines Double Column Camera Ready.pdf:application/pdf},
2171  pages = {1--15},
2172  keywords = {classroom use is granted, copies are not made, design fction, design fiction, ethics, or, or distributed, or hard copies of, part or all of, permission to make digital, this work for personal, values advocacy, values in design, values work, without fee provided that},
2173  year = {2021},
2174  month = {May},
2175  author = {Wong, Richmond Y. and Nguyen, Tonya},
2176  publisher = {ACM},
2177  booktitle = {Proceedings of the 2021 {CHI} {Conference} on {Human} {Factors} in {Computing} {Systems}},
2178  doi = {10.1145/3411764.3445447},
2179  url = {https://dl.acm.org/doi/10.1145/3411764.3445447},
2180  isbn = {978-1-4503-8096-6},
2181  title = {Timelines: {A} {World}-{Building} {Activity} for {Values} {Advocacy}},
2182  address = {New York, NY, USA},
2183}
2184
2185@inproceedings{shen_value_2021,
2186  file = {Full Text:C\:\\Users\\rwong34\\Zotero\\storage\\GVPZPA5Y\\Shen et al. - 2021 - Value Cards An Educational Toolkit for Teaching S.pdf:application/pdf},
2187  pages = {850--861},
2188  year = {2021},
2189  month = {March},
2190  author = {Shen, Hong and Deng, Wesley H. and Chattopadhyay, Aditi and Wu, Zhiwei Steven and Wang, Xu and Zhu, Haiyi},
2191  publisher = {ACM},
2192  booktitle = {Proceedings of the 2021 {ACM} {Conference} on {Fairness}, {Accountability}, and {Transparency}},
2193  urldate = {2023-01-19},
2194  language = {en},
2195  doi = {10.1145/3442188.3445971},
2196  url = {https://dl.acm.org/doi/10.1145/3442188.3445971},
2197  shorttitle = {Value {Cards}},
2198  isbn = {978-1-4503-8309-7},
2199  title = {Value {Cards}: {An} {Educational} {Toolkit} for {Teaching} {Social} {Impacts} of {Machine} {Learning} through {Deliberation}},
2200  address = {Virtual Event Canada},
2201}
2202
2203@misc{zevenbergen2020explainability,
2204  copyright = {Creative Commons Attribution 4.0 International},
2205  year = {2020},
2206  publisher = {arXiv},
2207  title = {Explainability Case Studies},
2208  keywords = {Computers and Society (cs.CY), FOS: Computer and information sciences, FOS: Computer and information sciences, K.4; K.3.2; I.2},
2209  author = {Zevenbergen, Ben and Woodruff, Allison and Kelley, Patrick Gage},
2210  url = {https://arxiv.org/abs/2009.00246},
2211  doi = {10.48550/ARXIV.2009.00246},
2212}
2213
2214@article{wong2023privacy,
2215  year = {2023},
2216  number = {CSCW1},
2217  volume = {7},
2218  journal = {Proceedings of the ACM on Human-Computer Interaction},
2219  author = {Wong, Richmond Y and Chong, Andrew and Aspegren, R Cooper},
2220  title = {Privacy Legislation as Business Risks: How GDPR and CCPA are Represented in Technology Companies’ Investment Risk Disclosures},
2221}
2222
2223@incollection{Schreck2013Disclosure,
2224  year = {2013},
2225  date = {2013},
2226  editor = {Idowu, Samuel O and Capaldi, Nicholas and Zu, Liangrong and Gupta, Das Ananda},
2227  author = {Schreck, Philipp},
2228  title = {Disclosure (CSR Reporting)},
2229  publisher = {Springer Berlin Heidelberg},
2230  isbn = {9783642280368},
2231  doi = {10.1007/978-3-642-28036-8},
2232  booktitle = {Encyclopedia of Corporate Social Responsibility},
2233}
2234
2235@misc{Kaissar2022Institutional,
2236  year = {2022},
2237  date = {2022},
2238  note = {[Online; accessed 2022-07-09]},
2239  author = {Kaissar, Nir},
2240  url = {https://www.bloomberg.com/opinion/articles/2022-04-13/institutional-investors-are-flexing-their-esg-muscles},
2241  title = {Institutional Investors Are Flexing Their ESG Muscles},
2242  journal = {Bloomberg},
2243}
2244
2245@misc{GlobalReportingInitiativeGRI,
2246  year = {0},
2247  date = {2022},
2248  note = {[Online; accessed 2022-07-09]},
2249  author = {Global Reporting Initiative},
2250  url = {https://www.globalreporting.org/how-to-use-the-gri-standards/gri-standards-english-language/},
2251  title = {GRI Standards - English},
2252  isbn = {9789088661334},
2253}
2254
2255@inproceedings{Krafft2021toolkit,
2256  series = {FAccT '21},
2257  location = {Virtual Event, Canada},
2258  keywords = {Participatory design, accountability, participatory action research, surveillance, algorithmic justice, regulation, algorithmic equity},
2259  numpages = {10},
2260  pages = {772–781},
2261  booktitle = {Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency},
2262  abstract = {Motivated by the extensive documented disparate harms of artificial intelligence (AI), many recent practitioner-facing reflective tools have been created to promote responsible AI development. However, the use of such tools internally by technology development firms addresses responsible AI as an issue of closed-door compliance rather than a matter of public concern. Recent advocate and activist efforts intervene in AI as a public policy problem, inciting a growing number of cities to pass bans or other ordinances on AI and surveillance technologies. In support of this broader ecology of political actors, we present a set of reflective tools intended to increase public participation in technology advocacy for AI policy action. To this end, the Algorithmic Equity Toolkit (the AEKit) provides a practical policy-facing definition of AI, a flowchart for assessing technologies against that definition, a worksheet for decomposing AI systems into constituent parts, and a list of probing questions that can be posed to vendors, policy-makers, or government agencies. The AEKit carries an action-orientation towards political encounters between community groups in the public and their representatives, opening up the work of AI reflection and remediation to multiple points of intervention. Unlike current reflective tools available to practitioners, our toolkit carries with it a politics of community participation and activism.},
2263  doi = {10.1145/3442188.3445938},
2264  url = {https://doi.org/10.1145/3442188.3445938},
2265  address = {New York, NY, USA},
2266  publisher = {Association for Computing Machinery},
2267  isbn = {9781450383097},
2268  year = {2021},
2269  title = {An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists},
2270  author = {Krafft, P. M. and Young, Meg and Katell, Michael and Lee, Jennifer E. and Narayan, Shankar and Epstein, Micah and Dailey, Dharma and Herman, Bernease and Tam, Aaron and Guetler, Vivian and Bintz, Corinne and Raz, Daniella and Jobe, Pa Ousman and Putz, Franziska and Robick, Brian and Barghouti, Bissan},
2271}
2272
2273@misc{crawford2018anatomy,
2274  url = {https://anatomyof.ai/},
2275  year = {2018},
2276  author = {Crawford, Kate and Joler, Vladan},
2277  title = {Anatomy of an AI System},
2278}
2279
2280@inproceedings{martelaro2020could,
2281  year = {2020},
2282  pages = {99--101},
2283  booktitle = {12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications},
2284  author = {Martelaro, Nikolas and Ju, Wendy},
2285  title = {What could go wrong? Exploring the downsides of autonomous vehicles},
2286}
2287
2288@inproceedings{contractor2022behavioral,
2289  year = {2022},
2290  pages = {778--788},
2291  booktitle = {2022 ACM Conference on Fairness, Accountability, and Transparency},
2292  author = {Contractor, Danish and McDuff, Daniel and Haines, Julia Katherine and Lee, Jenny and Hines, Christopher and Hecht, Brent and Vincent, Nicholas and Li, Hanlin},
2293  title = {Behavioral use licensing for responsible AI},
2294}
2295
2296@misc{carlosmunozferrandis2022openrail,
2297  file = {/Users/dwidder/Zotero/storage/R82UYXH9/open_rail.html},
2298  howpublished = {https://huggingface.co/blog/open\_rail},
2299  abstract = {We're on a journey to advance and democratize artificial intelligence through open source and open science.},
2300  month = {August},
2301  year = {2022},
2302  author = {{Carlos Munoz Ferrandis}},
2303  shorttitle = {{{OpenRAIL}}},
2304  title = {{{OpenRAIL}}: {{Towards}} Open and Responsible {{AI}} Licensing Frameworks},
2305}
2306
2307@misc{hippocratic,
2308  author = {Organization for Ethical Source},
2309  title = {The Hippocratic License: An Ethical License for Open Source},
2310}
Attribution

arXiv:2303.07529v1 [cs.CY]
License: cc-by-4.0
Thinking Upstream: Ethics and Policy Opportunities in AI Supply Chains

Looking upstream

Acting upstream

Bibliography

Attribution

Related Posts

Beyond Near- and Long-Term: Towards a Clearer Account of Research Priorities in AI Ethics and Society

Responsible Machine Learning Systems

Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
