Manufacturing Responsibility in Biotech Commercialization
ABSTRACT. How is responsibility practiced and made legible in in collaborations between universities and industry in the context of new emerging biotechnologies such as engineering biology? Engineering biology is the use of biological systems, such as microorganisms, cells, or enzymes, to make products like medicines, biofuels, food ingredients, and materials. It leverages biotechnology to grow and optimise these systems for large-scale production in industry, aiming to contribute to sustainable bioeconomies through biomanufacturing (Aguilar, 2019; Ayrapetyan et al. 2022). In multiple countries programmes have been initiated to develop and coordinate academic biotechnology research and industrial capabilities to generate scaled innovation in key sectors of pharmaceuticals, value-added chemicals, engineering materials, and advanced synthetic fuels.
Biomanufacturing also raises concerns about such issues as sustainability, resource inequality, biosecurity, dual-use, and public trust (Kemp et al, 2020; Shapira et al. 2022), which for example could include questions of dual use. For example, proponents emphasize their commitments to sustainability, claiming that biomanufacturing can provide alternatives to fossil fuel dependency. From this perspective, sustainability and commercialisation are imagined as working hand in hand. However, literature in responsible innovation questions this assumption, suggesting that sustainability and commercialisation are not inherently allied and require explicit and ongoing attention, reflection, engagement, and ethical scrutiny (Asveld 2021) and this is also relevant for biomanufacturing (Holland et al. 2024).
Moreover, biomanufacturing as part of the bioeconomy represents a powerful sociotechnical imaginary. It involves collections of (industrial and public) stakeholders, strengthened by the institutions that they inhabit, who promote specific visions about the benefits of commercial biotechnology that are powered by assumptions about how society should be organised. The concept of a bioeconomy can be understood as a sociotechnical imaginary, defined by Sheila Jasanoff (2015, p.4) as “collectively held, institutionally stabilized, and publicly performed visions of desirable futures, animated by shared understandings of forms of social life and social order attainable through, and supportive of, advances in science and technology”. Sociotechnical imaginaries analytically draw together the values and meanings embedded in innovations with their material manifestations through sociomaterial networks and assemblages. They pay close attention to questions of power, particularly where competing visions of the future struggle for dominance. Because of their relation to power is important to probe how these visions are co-produced by those working in academia and industry, particularly as they relate to understandings of how this can be done responsibly and in the public interest.
This paper derives from a study of a national UK biomanufacturing intermediary facility. This facility is established at a research university as a public-private partnership and designed to advance biomanufacturing commercialization. The facility is committed to innovating responsibly with a particular focus on sustainability. The overarching research question is: “how is responsibility practiced and made legible in the context of biomanufacturing in collaborations between universities and industry?” Sub research questions include, “how does responsibility as imagined by the biomanufacturing facility compare with public perspectives on commercial innovation?” and “how can industrial biomanufacturing be made publicly accountable?”
The research involves interviews and workshops with researchers and industry partners that seek to understand how responsibility in commercial biotechnology is understood and practiced. This empirical work further aims to uncover dilemmas, tensions, and contradictions alongside forms of legitimation and authority that are used to support specific views on responsibility. The research also involves analysis of grey literature associated with the facility and its research focus to get a sense of how responsibility has been institutionally encoded through discourses on governance, EDI, sustainability, and responsible innovation. The conference paper presents preliminary results from this research.
The research is undertaken within a framework that seeks to bring critical social science perspectives to innovation policy and practices. This involves exploring issues of power, governance, responsibility, and public accountability. These issues are the core focus of the field of responsible innovation (RI), understood broadly as “taking care of the future through collective stewardship of science and innovation in the present” (Stilgoe, Owen, Macnaghten 2013). RI is a field of academic study and a framework of ethical practice, making it highly suitable for a study of this kind which seeks to both understand and advise on responsibility. RI views responsibility less as a series of principles or values that are adhered to and more as a context-specific set of practices that involves anticipating future impacts of innovation, reflecting on underlying values and assumptions driving research, including diverse viewpoints on how innovation and knowledge should be implemented, and responding and adapting to these insights in ways that align innovation with broad societal needs. From this perspective, innovation is responsible when it is publicly accountable (Ribeiro et al. 2018), while also adhering to the more narrowly defined criteria of research ethics and integrity, and legal and regulatory requirements. The research iteratively analyses the data both inductively and deductively – working from the data but guided by the epistemic and political framing provided by RI and sociotechnical imaginaries. The data is analysed alongside findings from previous research on public views of what it means for innovation to be responsible to understand how responsibility is co-produced and how it compares to public understandings.
Prior work has pointed out that scientists’ and industry professionals’ ideas about which issues are relevant to ethical consideration do not align with the publics’ (Macnaghten, Kearnes, Wynne 2005). Where science and industry typically focus on risk categories that can be quantified and measured, the public is more concerned about issues of control, governance, purposes, and ownership (Macnaghten, Kearnes, Wynne 2005). Seen from this angle, the strategies for sustainability and commercialisation viewed by engineering biology research and industry stakeholders as inherently responsible might simultaneously be perceived by publics as a fundamental ethical tension. The research aims to offer fresh insights on this conundrum, probing how biomanufacturing imagining interacts with public understandings of responsibility and exploring opportunities for policy and institutional strategies that can address this tension.
Local Governance Capacity, Social Capital and Inclusive and Sustainable Innovation in Colombia
ABSTRACT. The pursuit of economic progress, social inclusion and environmental sustainability in contemporary societies in the Global South necessitates a nuanced understanding of local innovation governance capacity (Kuhlmann and Ordoñez-Matamoros, 2017; Pérez and Ordóñez-Matamoros; 2022), specially when it comes to better understanding its role in fostering structural transformation via both technological and social innovation (Chataway et al, 2017; Ordoñez-Matamoros et al, 2021a; Pinzón-Camargo et. al., 2023).
As Schot and Steinmueller (2018) have pointed out, despite the growing recognition of social innovation as a catalyst for positive societal change, its conceptual ambiguity and the absence of robust governance and measurement frameworks (Van der Have and Rubalcaba, 2016), pose significant challenges to policymakers and practitioners alike (Edwards-Schachter, M. and Ordoñez-Matamoros, H.G., 2023). This paper examines the intricate interplay between local governance capacity and inclusive and sustainable innovation, with a focus on Global South contexts: paradoxical combinations of, on the one hand, poverty, inequality, unemployment, informal or even illegal ecosystems, institutional sclerosis, corruption, social injustice, insecurity, violence and/or environmental vulnerability, among others and, on the other hand, entrepreneurship, resilience, cultural diversity, resourcefulness and creativity of its population and institutions and/or abundant natural wealth, among other features. We use Colombian local communities as example.
Drawing on a multi-disciplinary literature, this study explores the evolving conceptual landscape of social innovation (Chataway et al, 2014; Fressoli et al, 2014; Papaioannou, 2014; Bergek et al, 2015), the role of social capital, trust and coordination as enablers of innovation (Pylypenko, H.M, Yu.I. et.al 2023), the role of insecurity and corruption within it, and their overall implications for local innovation governance structures in developing countries (Bortagaray and Ordoñez-Matamoros, 2012; Ordoñez-Matamoros, 2021b; Pinzón and Centeno, 2021; Pinzón, Ordoñez-Matamoros and Kuhlmann, 2022).
By employing a mixed research methodology, including policy and academic documents consulted, statistical and case studies analyses and stakeholder interviews, the paper studies the mechanisms through which local governance capacity depends on social capital structures instrumental for facilitating (or not) innovation initiatives aimed at promoting economic development, social inclusion, well-being and environmental sustainability in contrasting contexts, beyond innovation policies centered on fostering the productivity and competitiveness of enterprises.
We found common denominators worth exploring further with respect to the ways in which local governments go about encouraging inclusive and sustainable innovations in such a particular type of contexts, and on the ways in which such processes are being accounted for.
The findings underscore the complex dynamics inherent in local governance systems, highlighting the need for stakeholder network and adaptive and context- sensitive approaches to foster inclusive and sustainable innovation processes effectively, including sort out problems defined by communities, but deriving lessons worth exploring beyond the Colombian cases studied. Indeed, the study identifies key determinants of local governance capacity, including social capital based on trust and coordination systems, institutional arrangements, participatory mechanisms, innovation process led by communities themselves and resource allocation strategies, which significantly influence the emergence and diffusion of inclusive and sustainable innovations.
Innovation Under Challenge: Human Capital Loss, Organizational Tenure, and the Resilience Effect of Female Representation
ABSTRACT. This study explores the nuanced impacts of tenure-specific human capital loss on firm innovation and examines the moderating role of female representation in mitigating these effects. Human capital has been considered as a critical driver for innovation. Firms increasingly grapple with the challenges posed by a competitive labor market and rising employee turnover. The increasing pressures have heightened concerns over the detrimental effects of human capital loss on innovation. In this context, researchers have emphasized the importance of preserving firm-specific knowledge to sustain innovation.
Despite extensive research on human capital loss, much of the focus has been limited to specific types, such as voluntary turnover, and narrow dimensions of its impact, particularly financial performance. The knowledge loss induced by employee turnover and its impact on innovation still remain underexplored. Furthermore, organizational tenure, which leads to varied levels of accumulated firm-specific knowledge, has been less highlighted. These gaps highlight the need for further exploration of the impact of employee turnover on knowledge retention and innovation, particularly focusing on organizational tenure as a key determinant of firm-specific knowledge preservation.
Building on the exploration of how the loss of experienced employees impacts human capital, it is highly necessary to explore how organizational strategies might lessen its impact on innovation. In particular, female representation within the workforce may hold untapped potential in mitigating these challenges. While female representation in enhancing firm performance has been studied, most research overlooks its broader workforce contributions and potential to mitigate the negative effects of human capital loss. This study addresses these gaps by drawing on the Knowledge-Based View and Human Capital Theory to further examine how tenure-specific human capital loss—classified as newcomers, tenured workers, and retirees—impacts firm innovation, and whether female representation serves as a contextual moderator in this relationship.
This study utilizes data from Korean firms collected in the 2011 (4th), 2013 (5th), 2015 (6th), and 2017 (7th) waves of the Human Capital Corporate Panel (HCCP). Our analysis focuses on 1,011 observations from Korean manufacturing firms. Firm innovation is measured by the number of patent registrations filed with the Korean Intellectual Property Office (KIPO), a widely recognized indicator of innovative output. Human capital loss is measured as the ratio of employees at different organizational tenure stages who left the company. Female representation is measured using two metrics: (1) the proportion of female employees relative to the total workforce and (2) a decile rank based on female workforce percentage. To test the hypotheses, this study applies a Poisson quasi-maximum likelihood (PQML) estimator to address the over-dispersed nature of patent count data while controlling for firm-level characteristics such as size, age, and workforce composition. Robustness checks include alternative modeling techniques, such as negative binomial regression, and supplemental measures of innovation (intellectual property) and female representation (Blau index).
Results reveal that human capital loss does not uniformly affect innovation. While general human capital loss has an insignificant impact, the loss of tenured workers significantly and negatively affects innovation. On the other hand, the loss of newcomers and retirees shows no significant effect. These findings align with the Knowledge-Based View and Human Capital Theory, which emphasize the critical importance of firm-specific tacit knowledge accumulated over time. Moreover, we found that female representation within the workforce plays a significant moderating role, mitigating the negative effects of tenured worker loss on innovation. Firms with higher female representation experience a less pronounced decline in innovation, highlighting the importance of female representation in knowledge loss environments resulting from human capital loss.
This study makes a significant contribution to the literature by highlighting the differential impacts of tenure-specific human capital loss on firm innovation, emphasizing the unique vulnerability posed by the departure of tenured workers. Existing research on human capital loss has largely overlooked the role of organizational tenure and its impact on innovation, instead focusing on specific departure types, such as voluntary turnover, and financial outcomes like sales and productivity. Our study addresses these gaps by highlighting the nuanced, negative effects of tenure-specific human capital loss on innovation, revealing that the departure of tenured employees, who often hold firm-specific tacit knowledge, has the most detrimental impact compared to newcomers or retirees.
Our study broadens the understanding of female representation’s role, by shifting the focus from diversity-driven perspectives to a knowledge-based lens, extending its strategic importance in the mitigating the effects of knowledge loss. While previous research has focused on the impact of female representation on firm performance, studies addressing how gender moderates the effects of human capital loss on innovation are scarce. Building on prior work, our findings reveal that female representation within the workforce can mitigate the negative impact of human capital loss on innovation, surpassing the positive reinforcement effects typically examined.
Moreover, our research highlights the extensive influence of female representation across all workforce levels, shifting the emphasis away from the traditional focus on women in top management roles. While previous research has focused on women in decision-making roles, such as CEOs, our findings shed light on the underexplored contributions of female employees in workforce for mitigating the negative effects of human capital loss on firm innovation, pointing to its strategic importance in fostering resilience and sustaining innovation.
This study offers practical implications that can inform organizational strategies and policies. It is wise for organizations to develop targeted retention strategies for tenured employees and invest in mechanisms to preserve their tacit knowledge. Simultaneously, promoting female representation can strengthen organizational resilience, creating a collaborative and knowledge-retentive environment essential for mitigating the impacts of knowledge loss.
Algorithms for what? Scientists' attitudes toward the relevance of human-computer collaborations in a U.S. bionanomaterials laboratory
ABSTRACT. Background
With the rapid expansion of Machine Learning (ML) and Artificial Intelligence (AI) technologies in the last decades, Human-Computer Collaboration (HCC) emerged as a promising avenue for research and development (R&D) activities. HCC is a paradigm of knowledge discovery wherein at least one human agent engages with a computing system characterized by varying degrees of automation, autonomy, or resilience (Valdés-Pérez, 1999). Scientists claim that HCC expanded significantly towards offering new possibilities in scientific discovery and exploration, facilitating the idealization of research hypotheses that transcend human limitations (Tschandl, P. et al., 2020).
HCC has played a significant role in fields as bionanomaterials research, i.e., a domain in which scientists manipulate complex biosystems processes and dynamics at nanoscale. In that area, the convergence of expertise from physics, chemistry, computation, engineering, and biology permits the development of new 2D/3D bio-architected nanomaterials which can be assembled autonomously to hold a desired function and/or a responsive behaviour to external triggers and stimuli (Shelin and Meenakshi, 2023). Bionanomaterials research focused on the understanding of biologically synthesized and conjugated nanoparticles and its applications, especially in the development of advanced nanoparticle-based targeted drug delivery systems (Kozierok et. al., 2021).
However, some scientists grapple with the dual challenge of ensuring the reliability, replication and human validation of HCC-based findings and large database, given the escalating complexity inherent in such systems (Xiong et. al., 2022). We still lack a comprehensive understanding of how the advancement and diffusion of HCC systems are affecting the relationship, conduct, processes, and the regimes of governance of expert knowledge production in emerging areas of convergence S&T – as well as what ethical questions and regulatory problems it raises that could compromise the future of AI in scientific work. This warrants robust empirical investigation addressing how researchers frame the relevance of HCC in a bionanomaterial laboratory, and under which ways that data could inform the production of ethics and responsible research guidelines, education policies for STEM capacity and research, and Science and Technology policymaking.
Aim
This article aims to investigate scientists’ attitudes toward the relevance of human-computer collaborations in a bionanomaterials laboratory in the United States. The study results from a thematic analysis of nine interviews applied with scientists of a respected research laboratory located in the New York Metropolitan Area in the summer of 2022.
Methods
This study applied an ethnographic work in a research laboratory as its main qualitative research approach. By immersing in the field, ethnographers aim to gather real-world evidence to understand the cultural phenomena within specific organizational contexts and shared social frameworks, employing various qualitative methods of data collection and analysis (Roller & Lavrakas, 2015). As supported by Atkinson, Coffey, and Delamont (2001), this research employed participant observation, interviews, and informal interactions in the laboratory to gather data on scientific practices, narratives and routines shared among researchers, machines, and their algorithms – in terms of how they active affect the social order and technopolitical configuration of expert knowledge in bionanomaterials. By adhering to these methodological approaches, the study seeks to contribute to the expanding body of knowledge on Studies on Expertise within the fields of Sociology, and Science, Technology and Society studies (Eyal and Medvets, 2023).
A total of nine staff scientists were interviewed for this study. The interviews consisted of two stages: an initial formal semi-structured conversation lasting approximately 30 minutes conducted in their respective offices or meeting rooms, followed by a more informal conversation during a guided tour of their facilities – aiming at interacting with the facilities, posters, photographs, and many machines in phase of prototyping, calibration or well-settled. Interviewees were selected based on their experience, roles, and availability within the laboratory, ensuring a comprehensive understanding of the work developed in that research facility. Interview transcripts were generated by TRINT and thematically analyzed through the assistance of Atlas.ti.
Results
The findings reveal some factors affecting experts' decision making on automating research on bionanomaterials: scientist’s experience in the field; reflections on the cost-benefit of automation investments; relevance of human validation of experiments; collective trust in autonomously generated molecules and materials by peers; and communicational issues experienced between researchers holding multiple disciplinary affiliations.
In areas of disruptive innovation such as bionanomaterials research, attitudes toward the relevance of HCC in the lab relate to stakeholders’ capacity to convince and produce consensus about why it is relevant to automate experiments and biomanufacturing work. While common sense might assume that automation is always desirable as a mechanism to enhance objectivity, precision, resilience, and productivity, it does evolve through routinary negotiations in specific organizational settings. By incentivizing the questioning among less experienced researchers on why algorithms are needed, Professors and Lab leaders support the co-production of new channels of dialogue that, not rarely, lands in the pragmatic frame/rational approach to decide about the use of scarce resources in the lab. Professors prioritize and foster human validation and re-experimentation of data to guarantee replicability and controlled levels of reproducibility.
Discussion
Attitudes toward the relevance of HCC in that bionanomaterials research facility involve a dynamic and multi-dimensional process that encompass both technical and non-technical arguments. In this case, scientists’ discourses on the ethics and objectivity of their research share room with concepts of relevance and pragmatism as crucial determinants of when automation makes sense.
The debate on when is relevant to automate is then responsible to co-create laboratory’s technopolitical infrastructures and narratives. Curiously, conversations about potential uses of AI to accelerate scientific research, in fact, stimulate researchers to value, even more, well-trained human resources to judge the epistemic aspects of HCC and its pragmatic relevance in the lab environment.
This resonates with current debates on the overestimated role of AI and other algorithm optimization technologies in radical innovation areas, indicating that we need to critically examine how the preservation of scientific objectivity, technical interventions and judgment on relevance of automation balance each other to stabilize emerging science and technology avoiding noise and community’s distrust.
AI and Future of Science: How is AI Transforming Science? Implications for Scientific Workforce Development
ABSTRACT. Artificial Intelligence (AI) is not just transforming the way we work—it is fundamentally redefining the future of scientific inquiry and innovation. This transformation demands a paradigm shift in how we prepare the scientific workforce of tomorrow and upskill today’s researchers. Despite its profound implications, science policy has yet to fully address the urgent need for a comprehensive framework to meet this challenge. This presentation examines the multifaceted impacts of AI on scientific workforce development, with a critical focus on curriculum innovation, equitable access to AI-driven tools, and ethical considerations in integrating AI into research practices. Drawing on a meta-synthesis of research on the future of work, we analyze how AI-driven workflows accelerate skill obsolescence and demand a reimagined approach to workforce readiness. However, the integration of AI into science is not without risks. Left unchecked, AI has the potential to erode the integrity of scientific processes and compromise science's role as humanity's most trusted epistemic practice. To mitigate these risks, we argue for a dual approach: equipping the scientific workforce with skills to ethically and creatively collaborate with AI, and developing robust standards for the production, evaluation, and critique of scientific knowledge in the AI era. Our findings offer actionable recommendations for policymakers, educators, and industry leaders. These include strategies to foster inclusivity, ensure responsible conduct, and enhance creativity in an AI-augmented scientific enterprise. By addressing these challenges collectively, we can secure the legacy of science as a driver of innovation and societal progress in the 21st century.
Breaking the Vicious Cycle: Adaptive Planning to Transform Vulnerable Cities into Resilient, Sustainable Models
ABSTRACT. In the Anthropocene era, cities are grappling with the dual challenges of climate change adaptation and sustainable development. Rapid urbanization, historical development inequalities, and the escalating impacts of climate change exacerbate these challenges, particularly for underserved and marginalized urban communities in both the Global North and South. Such communities often bear disproportionate climate burdens, yet existing adaptation policies can inadvertently reinforce inequities. Given the complexities of urban systems and the potential policy trade-offs between adaptation and development, it is crucial to align adaptation efforts with development priorities to promote sustainable and resilient cities.
Achieving this alignment often requires innovations and system changes, with sustainability transitions serving as a key to reshaping urban futures. Through technological or institutional-level innovations, cities are encouraged to transform pressing challenges into attainable objectives. While recent studies have documented progress in such innovations, especially at the technological levels, the critical question remains: “innovation for what?” (Chaminade, 2020). Traditional approaches to innovation, often driven by private sector dynamism and risk-taking, are ill-equipped to address the systemic challenges posed by climate change. To confront these long-term sustainability issues, which often stem from entrenched inequities, smart, inclusive, and transformative innovations are necessary. As advocated by The Earth Institute at Columbia University and Ericsson (2016), “transformation of societies” beyond business-as-usual approaches is needed to achieve the Sustainable Development Goals (SDGs).
Thus, innovation for a sustainable future requires more than one-dimensional changes. To foster sustainable adaptation, it is essential to focus on vulnerability – specifically, as a critical intersection between adaptation and development. Although vulnerability is frequently highlighted in adaptation and development literature as a central consideration, most studies focus on assessing vulnerability as a set of localized indicators without fully examining its ontological role as the bridge between adaptation and development. This study aims to fill that gap by examining the “lock-ins” of vulnerability within urban adaptation planning. With this approach, the temporal and spatial dynamics of vulnerability can be captured in the feedback loop between adaptation and development.
This research introduces a theoretical framework centered on the “lock-ins of vulnerability,” a concept underexplored in prior studies despite its critical importance, as noted by the IPCC (2022), which has identified “increased evidence of maladaptation across many sectors and regions…that are difficult and expensive to change and exacerbate existing inequalities.” These lock-ins are path-dependent mechanisms rooted in the institutional, technological, and cultural aspects of adaptation planning that hinder cities’ progress toward resilience. By dissecting these mechanisms, this study sheds light on the underlying causes that exacerbate vulnerability, providing insights into transformative changes that may enable cities to shift from maladaptive practices to sustainable adaptation pathways.
To analyze this framework in urban practices, the study conducted a survey of urban practitioners from 42 cities and employed fuzzy-set Qualitative Comparative Analysis (fsQCA). This approach allowed for an in-depth investigation of how institutional, technological, and cultural lock-ins influence cities' sensitivity to climate-related disasters and their adaptive capacity. The fsQCA method uncovered different pathways that either reinforce or alleviate vulnerability, revealing the conditions under which lock-ins interact to prevent cities from achieving resilience. The results underscore the role of specific lock-ins in constraining cities’ ability to respond to climate challenges and demonstrate the ways in which these lock-ins intersect to trap urban systems in the vicious cycle of vulnerability.
Notably, the study found that institutional and cultural lock-ins play particularly significant roles in shaping adaptive capacity. Cities with higher adaptive capacities often share unlocked institutional and cultural barriers, which would otherwise limit their ability to implement effective adaptation strategies. In the meantime, high sensitivity to climate risks arises from multiple different conditions depending on different local contexts although often closely related to rigid institutional frameworks and technological constraints that resist change. The findings suggest that policy interventions aimed at enhancing adaptive capacity must address these institutional and cultural constraints. By breaking these lock-ins, cities can create more inclusive and flexible environments that support transformative adaptation efforts.
Further analysis revealed a strong association between institutional and cultural lock-ins, with the two factors often reinforcing one another. This interdependence was evident in cases where overcoming institutional barriers also led to shifts in cultural and cognitive norms. Specifically, breaking institutional lock-ins was sufficient to unlock cultural and behavioral conventions in certain contexts, indicating that institutional reforms can pave the way for broader societal change. This finding emphasizes the need for integrated policy approaches that simultaneously address multiple lock-in dimensions to foster more adaptive urban environments.
The study contributes valuable insights into the systemic barriers that hinder urban adaptation and provides empirical evidence to support targeted interventions for sustainable adaptation. By identifying the complex interactions among different lock-ins, this research offers a framework for city officials and practitioners to understand how specific constraints can be dismantled to promote resilience. Moreover, the study’s findings advocate for a shift toward “transformational adaptation” – an approach that entails comprehensive changes in adaptation planning, combining technological innovation, institutional reform, and cultural transformation. Such an approach encourages cities to question established assumptions and values, fostering an environment where adaptive capacity can be strengthened across diverse urban contexts.
In conclusion, this study underscores the need for cities to address the multi-dimensional lock-ins of vulnerability within adaptation planning. The lock-ins of vulnerability framework offers both theoretical insights and practical guidance for policymakers seeking to transform maladaptive practices into sustainable adaptation pathways. By focusing on transformational adaptation, cities can move away from the vicious cycle of vulnerability and toward the virtuous cycle of sustainable adaptation and development. This research provides a valuable resource for urban practitioners aiming to design solutions that not only enhance adaptive capacity but also ensure that adaptation efforts align with broader development goals, paving the way for resilient and sustainable urban futures.
Are Social Innovation Practices Relevant for the deployment of Green-oriented projects? Firm-level evidence from Chile
ABSTRACT. Background and rationale.
The pressing need to pollute less (and the urgency to mitigate negative effects stemming from climate change) has sparked widespread attention about the set of green oriented innovation strategies currently being implemented by private companies. Green innovation is generally defined as those environmentally friendly actions that tend to have an impact over firms’ scientific projects (inventive outcome and level of product newness). These include strategies for lower consumption of given materials, initiatives to decrease energy and water use, projects for environmental damage reduction, health and safety improvement, and so forth.
While technological, market and regulatory factors have been regarded as key eco-innovation drivers, few studies have explored the extent through which such sustainable schemes can also be influenced by other relevant elements such as firms’ willingness to engage in social innovation practices. Social innovation embodies the development of new initiatives, products, processes or services that are suitable to address ongoing societal challenges. Over recent years, these practices have been highlighted as novel aspects that might also shape innovative business strategies. They relate to factors like social entrepreneurship, projects conducted by non-profit organizations along with initiatives for corporate social responsibility. Against this backdrop, our research aims to explore the role played by social innovation in also shaping sustainable planning through a firm-level approach.
Data and Methods
Chilean innovation surveys biannually divulged by the country’s statistical office (Instituto Nacional de Estadísticas, INE) constitute our main source of micro-level information. Such datasets report many innovation related variables including predominant type of innovation strategy being pursued (product, process, organizational and marketing), composition of R&D expenditures, availability of skilled workers, policy instruments to support scientific activity, among others. They also report variables accounting for the relevance to pursue eco-innovation strategies as well as future intentions to engage on social innovation. Our research will rely on a recent pooled sample of firms (generated by INE) which contains standardized micro data from the 11th and 12th wave of the country’s innovation datasets that comprehend the years between 2017-2018 and 2019-2020, respectively.
To adequately meet our empirical objectives, this research implemented an ordinal logit regression analysis. This econometric procedure entails examining the resulting relationship between a categorical (ordered variable) and a prearranged set of independent predictors. This is our case since Chilean companies perception about the relevance of sustainable activities are reported within our dataset as ordinal variables (with 1 being irrelevant and 4 highly important). Following prior empirical studies on Chile, we consider to two type of eco-innovation strategies as dependent variables: 1) resource efficiency (which entails plans to reduce energy consumption and the use of given materials), and 2) sustainable sensitiveness (which pertain to projects for environmental damage reduction as well as for health and safety improvement). To have additional insights into the importance of green initiatives of any sort, our research also introduced a third dependent variable (full eco-innovation) which is herein operationalized as the sum of the two recently advanced indicators.
Social innovation practices are operationalized as a binary independent variable underscoring firms’ willingness to embark on such type of strategies in the future. Factors such innovation capabilities (sum of inventive strategies followed by the organization), reliance on cooperative agreements, type of ownership (foreign or domestic), production for exports, access to government aid, sector of economic activity, prior experience on eco-innovation strategies, together with indicators for firm size and age are too included as additional predictors in our ordinal regression. It is also worth noting that (to account for potential endogeneity concerns) our dependent variables are solely examined in time t (2020), while each of the previously independent regressors are correspondingly evaluated at time t-1 (2018).
Econometric results.
Our general regression results can be summarized as follows:
1) Future intentions to conduct social innovation practices (reported in period t-1) positively shape the deployment of full eco-innovation schemes (executed in time t). Nevertheless, when each green oriented projects is individually addressed, we note that social innovation only seems to induce higher sustainable sensitiveness, thereby standing as irrelevant for the deployment of resource efficiency strategies.
2) Higher innovation capabilities, increasing exporting activity and foreign ownership (MNEs) stand as powerful predictors of either type of eco-innovation activity herein considered.
3) Participation in cooperative agreements with other research institutions generates a stronger impact on resource efficiency projects than on those that are related to sustainability.
4) Access to government aid increases firms’ positive perception on sustainable sensitiveness practices to a greater extent than they do for resource efficiency.
5) Prior knowledge on resource efficiency projects (as reported by the firm in time t-1) influences the execution of either individual green innovation activity in period t. Nevertheless, former experience on sustainable initiatives only motivates the pursuit of similar environmental strategies of this sort (in time t), and reports no relevant effect on resource efficiency schemes.
Conclusions and points for discussion.
These results have strong policy implications as they highlight the fact that green innovation activities at developing countries might be differently affected by technology, market and regulatory elements depending on the environmental priority that firms seek to improve on. While stressing the idea that social innovation might raise firms’ awareness to also pursue strategies for sustainable sensitiveness (i.e., environmental damage reduction), we also observe that such type of societal-related initiatives do not necessarily spark interest in pursuing other more complex green oriented projects .The fact that energy efficiency projects were found to heavily rely on firms’ prior experience on these type of initiatives (as well as on the presence of cooperative agreements) underscores that search for lower costs stands as a more relevant determining factor than societal awareness over this specific endeavor.
Enhancing Public Acceptance of Energy & Environmental Policies through Real-time Information Provision: Does it Last?"
ABSTRACT. The transition to a sustainable energy future necessitates large-scale energy transformation. The transition must not only achieve climate targets without unnecessary disruption to economic activity, but must also be socially and politically acceptable. Energy adaptations that are perceived to impose an undue burden on consumers will not be implementable. Various interventions to increase policy acceptability have been conducted, but the most effective communication channels and the duration of their effects remain uncertain. This work deciphers the role of information provision on the public acceptability of key energy and climate policies and the persistence of these effects over time. We aim to answer three questions:
• Do people change their pre-existing acceptance of key energy and climate policies when presented with new information regarding the policies’ outcomes?
• What type of information (environmental, economic or equity outcomes) is most likely to influence change in acceptability?
• Are information provision effects sustained over time?
To answer these questions, we conduct an innovative behavioral experiment featuring a unique feedback mechanism based on real-time information provided by a macroeconomic model. We conduct a follow-up study after six months, and report the conditions under which information provision effects are persistent.
Our case study is Ireland, a European country with ambitious climate policies, such as the Climate Action Plan, which considers increased deployment of sustainable energy and energy efficiency technology, together with increases in carbon taxation. With a nationally representative sample of 1,000 adults, we run the behavioral experiment and ask participants to state their preferences and acceptance of five policies that are included in the 2021 Climate Action Plan. These are:
1. Increasing renewable electricity up to 80% by 2030.
2. Increasing carbon taxes to 100 Euros (approx. $105/ton) by 2030- compared to the previous rate of 33 Euros ($35)/ton.
3. Distributing carbon tax revenues to households, in the forms of social protection payments and assistance for energy efficiency improvements.
4. Increasing the number of electric vehicles to 1,000,000 by 2030.
5. Increasing the number of heat pump installations to 600,000 by 2030.
Immediately afterwards, each participant receives tailor-made information about the long-term environmental, economic and equity outcomes of the policies they have accepted. The latter outcomes are predicted by the Ireland Environment, Energy and Economy model, our established computable general equilibrium model that simulates the Irish economy in its entity. We model 32 possible scenarios, with each scenario representing the implementation of some- or all- of the policies. Depending on their answers, participants immediately see on the screen the outcomes of a unique scenario in the form of infographics. If participants originally indicated that they agree (disagree) to some extent with a specific policy being implemented, the scenario will simulate that the policy is (is not) implemented. Furthermore, if they originally indicated that the majority (minority) of carbon tax venues should be distributed to support social protection or climate targets, the generated scenario will reflect that too. After viewing the results, the participants have the choice to update their preferences if they wish to, up to two times, and see how their updated answers affect expected outcomes.
Key information about policy outcomes include:
• Environmental outcomes: changes in carbon dioxide emissions.
• Economic outcomes: changes in unemployment and in cost of living.
• Equity outcomes: changes in real disposal income for low-income and for high-income households.
Through transition matrices, we assess the probabilities of participants to assign higher scores after the intervention, compared to those they assigned before the intervention. To explore the relative effect of each information type, participants are randomized so that 25% of them receive information about the environmental outcomes only, 25% receive information about the economic outcomes only, 25% about the equity outcomes only, and other 25% about all three outcomes. Other interests include whether the existing or updated levels of policy acceptance depend on: prior knowledge about these policies, perceived effectiveness of the techno-economic innovations the policies entail, perceived importance of each outcome, perceived behavioral control of each outcome, and most trusted source of information about climate change. We employ panel regression models to assess the role of each parameter in shaping acceptance of the policies. We also study the heterogeneity of effects across various socio-demographic groups. After six months, we conduct a follow-up study to explore whether participant preferences, as given at the end of the behavioral experiment, have been modified, or not, and to what extent.
Both our transition matrices and regression models indicate that informing the public about the impacts of all climate policies significantly increases their acceptance. It is noticeable that even participants with very low initial levels of acceptance display noteworthy probabilities for high levels of acceptance post-intervention. Furthermore, we found that changes in policy acceptance are associated with a combination of information provision, socio-demographics and personal values. Providing combined information about three types of outcomes (environmental, economic, and equity) is often more effective than information about a single type. Among the various types of information, environmental information is found to be the most influential, followed by information about equity outcomes. Perceived behavioral control of the environmental outcome was another significant predictor that emerged. After six months, we observe that intervention effects have been sustained mostly for participants who had demonstrated mid-level acceptance of the policies at the end of the initial experiment. On the other hand, participants who had demonstrated high levels of acceptance at the end of the initial experiment, now demonstrate lower acceptance.
Overall, this work provides valuable insights into designing and communicating climate policies that are likely to gain long-term social acceptance. Our results create optimism that public acceptance of policies for energy and climate can be increased through carefully-designed and well-communicated information provision. This is particularly noteworthy in the case of acceptance of carbon taxes, considering that the latter are traditionally considered unpopular. At the same time, our results demonstrate the difficulty of sustaining high levels of acceptance over time without re-enforcement, and highlight the need for continuing efforts to maintain acceptance through information provision strategies.
Research university assortativity conditions the integration of regional innovation systems
ABSTRACT. Abstract: Despite substantial policy efforts aimed at developing regional innovation systems (RIS), our understanding of institutional factors that promote synergy and integration at the regional scale is limited. To address this gap, we analyzed historical patterns of research co- production within and across California (CA) and Texas (TX), two RIS that together account for >5% of global scientific production. This predominance is largely attributed to the University of California and the University of Texas, two multi-campus university systems (MUS) that feature distinct configurations of institutional specialization. We exploit these differences to analyze four institutional assortativity channels that foster system-level synergies: institutional proximity, prestige, homophily, and specialization. Our results show that regional integration is mediated by the alignment of institutional specialization and moderated by institutional homophily, which thereby highlights MUS as valuable sources of institutional redundancy and variation that generate a large combinatorial space of potential multi-university research synergies. This configurational advantage is supported by results showing that research co- produced with a premier regional university and an international university feature a 21% (CA) and 25% (TX) citation premium. Hence, RIS administrators can extend productive capacity and global impact by identifying institutional synergies that optimize for both regional integrity and international competitiveness.
Summary: Regional innovation systems (RIS) are the foci of substantial science policy initiatives aimed at strategically integrating national and pan-national innovation systems by supporting the co-production of knowledge and the circulation of high- skilled labor. Chief among the institutional and geographic fixtures that define regional innovation systems (RIS) are research universities (RU) [2–4], which represent sources, anchors and hubs [5] across vast multi-level networks of human, social and intellectual capital. Here we present a framework for understanding how institutional assortativity – broadly defined as institutional similarities that support research co- production affinities that persist over distance and time – promotes RU ecosystem integration at the regional scale. Accordingly, in what follows we analyze four distinct channels of institutional assortativity: proximity, prestige, homophily, and specialization.
Regarding regional proximity, we focus upon California and Texas, two geographically and politically distinct regions within the US innovation system. A principal component of our RU sample are the 10 institutions belonging to the University of California (UC) system and the 12 institutions belonging to the University of Texas (UT) system. We complement these two public multi-campus university systems (MUS) with six prominent private universities that form a non-MUS comparison group. Together, the 28 RU in our sample are affiliated with roughly 3 million publications collected from Clarivate Analytics Web of Science Core Collection (WOS), representing >5% of publications indexed by WOS over the sample period 1970-2020.
Regarding institutional prestige, previous research emphasizes premier universities because they generally produce research in large volumes [6, 7]. Instead, our focus at the regional scale exposes the broad distribution of institutional sizes, including the more numerous yet less prolific public universities that nevertheless generate commensurate research and education contributions on the aggregate [1]. There is considerable variation in research production among UC and UT institutions, which contributes to broader prestige hierarchies observed in science [7–9.
Another key characteristic of MUS is the replication of organizational principles and policies across various locations, meaning that certain aspects of institutional environment can be considered approximately fixed across the different campuses (e.g. tenure and promotion policy). Such organizational commonalities also promote homophily, whereby social groups tend to initiate and persist via the identification of shared attributes, values and experiences. The great number of graduates generated by MUS thereby generates several distinct avenues that reinforce institutional homophily, including but not limited to collaboration, employment, student admissions and brand equity. Thus, the direct and indirect network effects generated within and across MUS campuses fosters a considerable organizational advantage relating to a fundamental objective of RU administration, which is to attract and retain prolific scholars [3].
And finally, we exploit the different organizational configurations of the UC and UT systems to understand how institutional specialization conditions the combinatorics of institutional alignment. Notably, the UT is comprised of a 7 campuses representing traditional multi- disciplinary RU, coupled with 5 campuses that are specialized biomedical and health science centers. Conversely, 9 of 10 UC campuses are traditional RU, the exception being UCSF which specializes in biomedical and health science research and graduate-level educational programs, akin to UT health science centers. From an organizational standpoint, the bureaucratic complexity of managing diversified universities [10] is likely to compound in MUS, especially if resource allocation and investments across the system are guided by principles of competitiveness, equity and transparency. The varying levels of institutional specialization among MUS members create trade-offs between redundancy and diversity, especially concerning the effectiveness of a uniform governance approach.
Our study thus targets a longstanding research question owed to Aristotle and tailored to modern RU ecosystems: How does variation among institutions manifest in operational synergies that enhance the productive capacity of the innovation system as a whole? Our findings emphasize the importance of public investment in multi-campus university systems, which serve as foundational pillars within RU ecosystems. From a stakeholder perspective, our framework may be instructive to institutional research development offices tasked with identifying strategic investments and multi-university funding opportunities.
References:
[1] Madhavan G, et al. (2020) NAE: The Bridge on Complex Unifiable Systems (National Academies Press).
[2] National Research Council (2012) Research universities and the future of America.
[3] Rouse WB (2016) Universities as complex enterprises (John Wiley & Sons).
[4] Rouse W. B., et al. (2018) Modeling research universities. PNAS.
[5] Owen-Smith J (2018) Research universities and the public good. (Stanford University Press).
[6] Adams JD, et al. (2005) Scientific teams and institutional collaborations: Evidence from US universities, 1981–1999. Research policy.
[7] Jones BF, et al. (2008) Multi-university research teams: Shifting impact, geography, and stratification in science. Science.
[8] Clauset A, et al. (2015) Systematic inequality and hierarchy in faculty hiring networks. Science Advances.
[9] Wapman KH, et al. (2022) Quantifying hierarchy and dynamics in US faculty hiring and retention. Nature.
[10] Walsh JP, Lee YN (2015) The bureaucratization of science. Research Policy.
Catalysts of Innovation: The Role of Multi-Location Firms in Local Knowledge Development
ABSTRACT. Abstract: Because the distribution of knowledge is uneven, multi-location firms build or acquire establishments in various locations in order to gain access to the local knowledge base (Beugelsdijk & Mudambi, 2013; Kafouros et al., 2018). In this way, the multi-location firm can access localized pools of knowledge that deepen its existing technology base or provide a means to diversify into high level technologies (Alcácer & Zhao, 2012; Frigon & Rigby, 2024). Less attention has been given to the impact of multi-location firms on local knowledge development. This study explores the effects of new multi-location firms’ establishments on local knowledge development through the lens of the dynamic regional innovation system. Specifically, we examine: (1) whether multi-location firms foster knowledge development by local firms and universities, and (2) how internal linkages within multi-location firms might influence local knowledge development. We focus on the semiconductor industry as our empirical setting, given its reliance on technological advancement for success (Wang & Zhao, 2018). To identify relevant companies, we select those that self-identify as operating within the semiconductor industry based on their membership in the Semiconductor Industry Association (SIA), following the approach of Feldman and Lendel (2010). Our investigation spans the innovation activities of 28 companies from 2016 to 2020, analyzing their patents, geographic locations, and establishments to gain insights into their contributions to technological progress. The data for this study comes from two main sources. First, we use patents from the USPTO and academic articles from Web of Science to analyze the knowledge flow and collaboration among local industries, universities and multi-location firms, as well as the internal linkages within multi-location firms. Second, we incorporate data from Crunchbase and OpenCorporates to track the subsidiaries and hierarchy of multi-location firms. By integrating these datasets, we match patents and articles to both inventors’ and firms’ R&D locations, allowing us to map the geographical and organizational structure of knowledge flows among local industries, universities and multi-location firms through co-authorship and citations. To measure local knowledge development, we focus on three key indicators: knowledge diversity, specialization, and complexity. These indicators are assessed using patents and papers from the perspectives of both local universities and industries, as both serve as critical drivers of innovative activity (Feldman & Lendel, 2010). This study contributes to a deeper understanding of how multi-location firms interact with and shape regional innovation systems. It uncovers the interplay between organizational structures and regional innovation systems, offering valuable insights into the dynamics of knowledge sharing in the context of multi-location operations.
References
Alcácer, J., & Zhao, M. (2012). Local R&D strategies and multilocation firms: The role of internal linkages. Management Science, 58(4), 734-753.
Beugelsdijk, S., & Mudambi, R. (2013). MNEs as border-crossing multi-location enterprises: The role of discontinuities in geographic space. Journal of International Business Studies, 44, 413-426.
Feldman, M. P., & Lendel, I. (2010). Under the lens: the geography of optical science as an emerging industry. Economic geography, 86(2), 147-171.
Frigon, A., & Rigby, D. L. (2022). Where do capabilities reside? Analysis of related technological diversification in multi-locational firms. Regional Studies, 56(12), 2045-2057.
Frigon, A., & Rigby, D. L. (2024). Geographies of Knowledge Sourcing and the Complexity of Knowledge in Multilocational Firms. Economic Geography, 100(4), 329-350.
Kafouros, M., Wang, C., Mavroudi, E., Hong, J., & Katsikeas, C. S. (2018). Geographic dispersion and co-location in global R&D portfolios: Consequences for firm performance. Research Policy, 47(7), 1243-1255.
Lavoratori, K., Mariotti, S., & Piscitello, L. (2020). The role of geographical and temporary proximity in MNEs’ location and intra-firm co-location choices. Regional Studies, 54(10), 1442-1456.
Wang, S., & Zhao, M. (2018). A tale of two distances: a study of technological distance, geographic distance and multilocation firms. Journal of economic geography, 18(5), 1091-1120.
Co-evolution of the global research collaboration network and the performance of nations in science and technology
ABSTRACT. Despite extensive research on the relationship between international research collaboration (IRC) and research performance in science and technology (S&T), existing research has mostly examined single or comparative case studies, relatively small samples composed of developed countries, and uni-directional relations between empirical indicators. Although large scale network studies of IRC are becoming more common, 1) drivers of IRC network formation and 2) effects of the IRC network on policy-relevant performance outputs tend to be analyzed separately. Large scale analysis of the reciprocal dynamic relationship between IRC and national performance has yet to be conducted.
This research tests network effects on performance and vice versa simultaneously using a longitudinal co-evolution model on three decades of global S&T network and performance data. We employ the stochastic actor oriented model (SAOM) framework, also known as Siena models, to analyze data on 166 countries from 1993 to 2022. Yearly IRC networks are constructed from Web of Science's XML database. Corresponding national S&T performance data is gathered from Elsevier's fractional field-weighted citation index (FWCI), which disentangles national from internationally attributed citation impact. The models also account for geographic distance, national wealth, population metrics, political governance, and endogenous network processes.
The preliminary results support the hypotheses with positive and significant estimates for both effects. However, geographic distance appears to play a critical role in the transmission of the social effect of performance on the IRC network. Indeed, not controlling for geographic distance renders this effect insignificant in the face of the endogenous network dynamic of preferential attachment. Further analysis will be conducted incorporating different sensitivity tests in addition to tests for disciplinary and temporal heterogeneity.
Collaborative Research for Innovation: a Pathway for Micro and Small Enterprises
ABSTRACT. Beyond its historical role in economic growth, innovation now takes on new dimensions, becoming essential in addressing contemporary issues (OECD & Eurostat, 2018). For innovation policies to contribute to economic growth, social progress, gender equality, and environmental performance, participatory Research and Development (R&D), which strengthens collaboration and engagement among diverse stakeholders, has to take these issues as part of their design, targets, monitoring and assessment. (Woolthuis et al, 2005; Elisa Arond et al., 2010; Galvao et al., 2019).
Furthermore, a transformative model of R&D and innovation must take into account the differences between countries in the Global South and North. As the world grapples with social and environmental issues, developing countries often need to deal with added hurdles that developed nations have already overcome (Lundvall et al., 2009; Mohamed et al., 2022).
Brazil faces persistent challenges in effectively leveraging private R&D investments. Despite longstanding government efforts, including tax incentives and economic subsidies, these measures have proven insufficient (Pacheco & Corder, 2010; De Negri, 2017; MCTI, 2021) to enhance the country's technological capabilities, drive innovation, and address societal challenges. In 2013, the Brazilian government founded the Brazilian Company of Research and Industrial Innovation (EMBRAPII), a private non-profit organisation designed to promote collaborative research between Research Organisations (ROs) and industry. This unique model within the country, inspired by the French Carnot Institute and the German Fraunhofer (Castro et al., 2017; Salles-Filho et al., 2021), holds significant potential to serve as a framework for addressing and overcoming this context of deficiency.
EMBRAPII receives funds from the Federal Treasury to support selected and accredited Research Organizations (ROs). After accreditation, these ROs are considered EMBRAPII Units (EUs). The EUs must pursue partnerships with companies to develop pre-competitive technological innovations aligned with the company's interests. Each project receives one-third of its funding directly from EMBRAPII, with the remaining portion funded by the company itself plus a counterpart from the EUs. On average, companies have contributed 50% of the investment per project.
The EMBRAPII model imposes governance schemes to enhance effectiveness. Funds are released only after the EU signs a contract with a company to develop specific projects, which are monitored by both parties and require company approval before completion. Upon project conclusion, an external expert reviews the process. In addition, EMBRAPII also provides training on project and innovation management and rewards performance.
We conducted an evaluation of the projects under the EMBRAPII model, with the specific interest of understanding the generation of innovation, the role of company size in this process, and the outcomes of these innovations for the companies in a multidimensional approach, measuring economic, social and environmental outputs, outcomes and impacts. After an extensive literature review, we analyzed exclusive data provided by EMBRAPII, which allowed us to define a sample of 940 projects completed between 2015 and 2023, carried out by 57 EUs and 718 companies, with 50% comprising small and micro-enterprises, and 41% medium and large companies (9% could not be categorized). Adding to that, we administered a questionnaire to the participating companies, yielding responses from 211 of them (29.5% of the sample).
Through the descriptive statistical analysis of data, and with the support of input-output analysis, cost-benefit analysis, and Qualitative Comparative Analysis, we seek to assess the impacts of Embrapii using the following indicators: generated innovations, with an emphasis on the percentage of innovations that reduced environmental impact; EMBRAPII's contribution to achieving innovation (redundant causality factor, as proposed by Salles-Filho et al., 2011); return on investment; generation of technological capabilities; and propensity to invest in R&D before and after the project. All indicators were analyzed with a segmentation by company size.
Our preliminary results indicate that 72% of projects conducted under the EMBRAPII model generated at least one innovation, of which 36.5% led to a reduction in environmental impacts. Furthermore, 51% of the companies said that the model contributed significantly to achieving innovation; 37% said they would not have undertaken the project without EMBRAPII funding, and 19% said they would have done it anyway. Our study also indicates that for every 200 thousand dollars invested by EMBRAPII, 450 thousand dollars are added to the Brazilian GDP and 33 jobs are created; and for every dollar invested by companies, 2.7 dollars are returned to them.
While this research is still ongoing and in-depth analyses are being finalized, we can already affirm that the EMBRAPII model has a positive impact on innovation generation in partner enterprises. Our preliminary data points to a greater impact of Embrapii on small and micro businesses: 85% of them achieved innovations, while this importance drops to 62% for medium and large companies. Medium and large companies also reported more frequently that they would have carried out the project regardless of the funding received.
In a country where the industry is traditionally less innovative and small businesses face pronounced barriers, collaborative models that include small and micro enterprises and are implemented under a broad governance framework (encompassing not only financial and technical oversight but also managerial governance) may present a new path of effectiveness in innovation policy.
Main references:
Elisa Arond, A. Ely, Martin Bell, M. Leach, Ian Scoones, & Andy Stirling. (2010). Innovation, Sustainability, Development: A New Manifesto. STEPS Centre.
Lundvall, B.-Å., Vang, J., & Joseph, K. J. (2009). Innovation System Research and Developing Countries. Em B.-Å. Lundvall, K. J. Joseph, C. Chaminade, & J. Vang (Orgs.), Handbook of Innovation Systems and Developing Countries. Edward Elgar Publishing.
Mohamed, M. M. A., Liu, P., & Nie, G. (2022). Causality between Technological Innovation and Economic Growth: Evidence from the Economies of Developing Countries. Sustainability, 14(6), 3586.
OECD & Eurostat. (2018). Oslo Manual 2018: Guidelines for Collecting, Reporting and Using Data on Innovation, 4th Edition. OECD.
Salles-Filho, S., Bin, A., Bonilla, K., & Colugnati, F. A. B. (2021). Effectiveness by Design: Overcoming Orientation and Transaction Related Barriers in Research-Industry Linkages. Revista de Administração Contemporânea, 25(5), 22.
Woolthuis, R. K., Lankhuizen, M., Gilsing, V. A system failure framework for innovation policy design, Technovation, Volume 25, Issue 6, 2005.
Science as a Vocation or a Job? How Scientific Norms Shape Different Forms of Research Misconduct
ABSTRACT. This paper examines the relationship between occupational norms and different forms of research misconduct. In recent years, once regarded as paragons of collegial organization (Blau, 1994), universities have increasingly adopted bureaucratic structures (Lee & Walsh, 2021), leading to a more metrified and commercialized system of knowledge production (Berman, 2011). At the same time, the scientific community has become more demographically diverse, raising the question of whether a single normative framework can adequately account for researchers’ varied motivations and behaviors (Woo & Walsh, 2024).
In this paper, we provide evidence suggesting that different research environments, shaped by either Mertonian norms or bureaucratic environments, predict distinct forms of misconduct. Under Mertonian norms, researchers internalize the values of sciences in pushing the boundaries of knowledge to gain social recognition rather than merely fulfilling institutional metrics (Merton, 1973). In contrast, researchers operating in a bureaucratized science are more likely to publish for the sake of accumulating publications, which directly count toward their performance evaluations (Biagioli & Csiszar, 2020). Such an environment may foster a high likelihood of goal displacement, turning publication into a means to an end.
More specifically, we posit that research misconducts committed by researchers from institutions or countries more aligned with the Mertonian norms are more likely to engage in “bold” research misconduct, deliberately altering evidence to publish in top journals (Park, 2020; Reich, 2009). This tendency paradoxically may stem from their strong adherence to Mertonian norms, particularly their emphasis on novelty (Zuckerman, 1988). Meanwhile, researchers from more bureaucratized research settings, who are not traditionally enculturated in the core, are less likely to share Mertonian norms and are more susceptible to institutional pressures to maximize metrified performance, such as the number of publications. We posit that this group is more prone to “petty” research misconduct, which may not critically damage core knowledge. Examples include plagiarism, fake peer review, and the use of paper mills.
We test our hypotheses using a series of regressions based on over 50 thousand retracted articles from RetractionWatch and bibliographic information obtained from OpenAlex. First, retracted papers from scientifically established countries, institutions, and prestigious journals, which we assume to be associated with traditional Mertonian norms, are more likely to involve bold misconduct, such as fabricating data, materials, or results. Meanwhile, retracted papers from less developed countries, institutions, and less prestigious journals are more likely to be associated with petty misconduct, such as plagiarism, paper mills, and peer review manipulation.
Our findings demonstrate that research environments shaped by Mertonian norms versus bureaucratic pressures produce distinct forms of misconduct. Researchers often engage in “bold” misconduct in Mertonian settings aimed at high-impact recognition. In contrast, those in bureaucratized contexts are more likely to commit “petty” offenses driven by institutional performance metrics. These insights carry important policy implications for universities and funding bodies, which should tailor their oversight and evaluation criteria to scientists’ unique pressures. We provide detailed policy recommendations and also address emerging concerns over the misuse of large language models (LLMs) in paper production, particularly in understanding which researchers, based on their normative environment, are more likely to use LLMs for misconduct.
References:
Berman, E. P. (2011). Creating the market university: How academic science became an economic engine: Princeton University Press.
Biagioli, M., & Csiszar, A. (2020). Gaming the Metrics: Misconduct and Manipulation in Academic Research: Mit Press.
Blau, P. M. (1994). The organization of academic work: Transaction Publishers.
Lee, Y.-N., & Walsh, J. P. (2021). Rethinking Science as a Vocation: One Hundred Years of Bureaucratization of Academic Science. Science, technology, & human values, 0(0), 01622439211026020. doi:10.1177/01622439211026020
Merton, R. K. (1973). The normative structure of science. In N. W. Storer (Ed.), The sociology of science: Theoretical and empirical investigations (pp. 267-278): The University of Chicago Press.
Park, B. S. (2020). Making matters of fraud: Sociomaterial technology in the case of Hwang and Schatten. History of Science, 58(4), 393-416.
Reich, E. S. (2009). Plastic fantastic: How the biggest fraud in physics shook the scientific world (Vol. 1): Macmillan.
Woo, S., & Walsh, J. P. (2024). On the shoulders of fallen giants: What do references to retracted research tell us about citation behaviors? Quantitative Science Studies, 1-30. doi:10.1162/qss_a_00303
Zuckerman, H. (1988). The sociology of science. In Handbook of sociology. (pp. 511-574). Thousand Oaks, CA, US: Sage Publications, Inc.
The (lack of) visibility of formal scientific criticism
ABSTRACT. # Introduction
Putting science into effective action—whether by informing policy, guiding practice, or planning a new study—requires that individual papers not be considered in isolation, but rather in the context of the wider scientific literature. A key consideration is the criticism a study receives. Healthy critique between academic peers helps to identify errors in the scientific record and forces scholars to reckon with competing evidence and assumptions. Criticism may also signal that a paper’s findings require further supporting evidence before informing policy and practice.
The utility of criticism rests on it actually being read, an assumption that may not actually hold in reality. Retracted papers have been found to accumulate citations and attention long after retraction, likely owing to scholars following heuristic-based citation strategies rather than carefully reading and engaging with the literature. The same may hold true for criticism.
This abstract details results of an ongoing project examining the visibility of criticism in science. I focus on critical letters: a publication type with the purpose of critiquing a recently published paper. Over 3,000 critical letters were sourced from several large, widely-read, and disciplinary-diverse journals in which they are routinely published sourced from the journals Nature, Science, PNAS, and the journals of the American Physical Society (APS). Bibliometric metadata is sourced from the final 2021 snapshot of the Microsoft Academic Graph and includes critical letters published between the years 2000 and 2018.
# Results
Visibility is examined along a number of dimensions. The first is based on citations accumulated. Across each journal, papers targeted by a critical letter continue to accumulate citations well after the criticism was issued. While there is a decline in annual citations, this does not appear attributable to the critical letter itself. In itself, this is unsurprising; criticisms are not like retractions, in which citation to the targeted paper which does not acknowledge the retraction is prima facie inappropriate. Other results not shown here suggest that critical letters have no detectable effect on the citations received by a paper. What is surprising is that the critical letters go comparatively uncited. Only a small fraction of citations to the targeted paper are accompanied by a citation to the critical letter—around 10% for elite generalist journals and 15% for APS journals in the initial years, declining over time. I also investigate visibility based on altmetric indicators. The number of tweets and news stories associated with a paper are sourced from the SciSciNet dataset. The results show that critical letters receive considerably fewer tweets and mentions in news stories than those they critique.
The visibility of critical letters is not uniform across all readers. Those authors most familiar with the field of the criticized paper are most likely to encounter the letter and consider it relevant to cite, whereas those readers from more distant fields may see the original paper but not its criticism. To test this, I use SPECTER, a fine-tuned version of the BERT language model, to generate vector representations for each paper targeted by a critical letter as well as for all its citing papers. The cosine distance between these vectors provides an approximate measure of topical similarity. A similar approach has been used previously to evaluate the topical distance between retracted papers and their post-retraction citations. After excluding replies and self-citations, I find that papers co-citing the critical letter tend to be among the most topically similar to the targeted paper. This effect is most pronounced in elite generalist journals such as Nature (μ = 59.3), Science (μ = 58.9) and PNAS (μ = 57.5). For the specialist APS journals, the effect is present but weaker, possibly because these journals primarily attract citations from within their own field, reducing the likelihood of cross-disciplinary citations.
In summary, critical letters appear to have limited visibility. These findings suggest that critical letters are most visible within their immediate disciplinary communities, whereas researchers in more distant fields may be less likely to encounter or cite the critical letter. This pattern implies that the influence of critical letters may be constrained by disciplinary boundaries, with limited impact on the broader academic audience.
# Significance
Criticism is widely regarded as a fundamental component of science and is necessary to holistically assess the state of the science on any particular topic. While critique is ubiquitous across all channels of scholarly communication, critical letters represent one of the clearest and most explicit forms of criticism in science. Yet these findings suggest that critical letters are not being widely read nor well incorporated into the academic literature.
Critical letters also provide a useful framework for understanding the implications of post-publication peer review, replications, red-team reports, and other forms of critique and review issued after a paper is published. Namely, such practices may run into similar issues of visibility.
These findings pose a challenge for science. Journals may consider interventions to ensure criticism is not overlooked, ensuring that citation practices reflect a comprehensive understanding of each work’s context. Particular care is needed where science guides policy or practice, such as in systematic review and evidence synthesis. Here, papers should be carefully considered in the context of their critiques.
Citizens' Repudiation of Science: An Integrative Theory
ABSTRACT. Often scientists (here including physical scientists, engineers, and social scientists) are at a loss to understand why ordinary citizens, including many who have extensive formal education, reject the data, findings, and theories produced by scientists, even when scientists view these forms of knowledge to be uncontroversial and consensually validated. The question of why non-scientist repudiate science is examined here, in depth, drawing from history, data, and current social, political and technological factors. My objectives include: (1) to provide a better framing by distinguishing between lack of trust (general) in science (general) and repudiation of science (specific), (2) to develop ideas about the circumstances in which science is and is not "a superior way of knowing" compared to other forms of knowledge (e.g., personal knowledge, craft knowledge, folk knowledge, moral knowledge) and why, (3)) to develop propositions about factors causing repudiation, including judgments as to criteria for assessing whether such repudiation is or is not "justified", (4) to provide a preliminary integrative theory about repudiation of science, and, finally, (6) to consider the implications of repudiation for public policy and some steps that scientist and policymakers may consider as they seek to mitigate socially harmful repudiation of science.
Novelty vs Impact? When the market reacts to patent quality disclosure?
ABSTRACT. The citation based indicators, reflecting the impact of patent on subsequent inventions, are extensively used to measure the quality of patent. At the same time, recent advancement in text mining techniques allows us to look into the novelty of invention by finding new contents which has not found before. A novel or radical invention can be a substantially impactful ones in the future, but it is not always the case. There is a fundamental trade-off between uncertainty in novelty and prominent impact in a process of emerging technology’s development (Rotolo et al, 2015). Understanding such tradeoff is important for STI policy makers in charge of public R&D support for risky projects with great uncertainty but also potential impactful in the future.
This paper address this issues by using our novelty indicator on contextual word embeddings that captures the acquisition or loss of semantics over time, across domains, or cultures by comparing the distribution of the same word across two corpora on a normalized hypersphere (Zhao and Motohashi, 2024). Together with conventional forward citation based impact indicator, we tracks the changes in economic value of a patent throughout the information disclosure process of the patent. Specifically, we investigate the relationship of novelty/impact indicators and stock market valuation of patent information disclosure (application publication and registration) based on the methodology of Kogan et al. (2017), by using 15,418 USPTO patents of 460 US listed pharma firms.
References
Kogan, L., Papanikolaou, D., Seru, A. and Stoffman, N., 2017, Technological Innovation, Resource Allocation, and Growth, The Quarterly Journal of Economics, 132(2), 665-712
Rotolo, D., Hicks, D. and Martin, B.R., 2015. What is an emerging technology?, Research Policy, 44(10), pp.1827-1843
Zhao, Q. and Motohashi, K. (2024), Tracking Semantic Changes with Contextual Embeddings: A Simple, Stable, and Interpretable Method, a paper submitted to AAAI conference, February 2025
The meaning of Novelty: Introducing the Novelty Vector using AI
ABSTRACT. This paper contributes to the literature on the assessment of transformation policies by introducing a new methodology and indicator framework to better measure scientific novelty. I explore the potential of harnessing advancements in Artificial Intelligence (AI) to develop a new concept – the novelty vector – by delving into unexplored mathematical properties of AI. The novelty vector proved to be an excellent student of novelty scores, learning from expert assessments and predicting high novelty scores with over 90% accuracy.
Methodologically, the approach consists of learning from expert assessment, instead of relying on simplistic assumptions or crude proxies. In an econometric model, the explanatory power of the “novelty vector" retains statistical significance after accounting for the quality of the proposals and applicants’ CVs. When applied to a different dataset of published papers, the “novelty vector" presents equally high levels of predictive power and is statistically significant when identifying Nobel prize-winning papers after accounting for scientific quality. This finding opens a new avenue for further understanding novelty in science and also enables the development of new tools to support policy evaluation in novelty assessment and detection.
Lack of risk-taking in scientific research is weighing on our capacity to generate breakthrough discoveries. We are in desperate need of highly novel and transformative discoveries that can help us tackle grand societal challenges like climate change, ageing, and global pandemics and boost productivity. Despite this need, existing tools to effectively inform, monitor and evaluate the capacity of policies to foster transformative research are notably limited. The lack of robust indicator frameworks for transformative research gives traditional bibliometric indicators an excessive prominence which makes matters worse. Traditional bibliometric indicators based on impact-factor metrics have been shown to be biased against highly novel, transformative research [see e.g. Wang et. Al (2017), OECD (2021) and Machado (2021)].
The current lack of accurate indicators to measure the novelty dimensions of science weighs on our capacity to promote transformational research projects and to monitor and evaluate science funding policies in their capacity to promote disruptive and high-risk/high-gain research. Instead of relying on artificial proxies of novelty defined by bibliometric and scientometrics experts with little knowledge of other scientific domains, this paper proposes a novel methodology that learns from expert reviews in different fields assessing the levels of novelty of scientific ideas in their domains of expertise.
This paper contributes to the scholarly literature dedicated to refining our understanding of the intricate nature of scientific novelty. Franzoni and Stephan (2023) acknowledge how challenging this research area is, encouraging others to take up this important topic. In this paper, I do so by investigating new avenues capable of measuring and predicting how novel new scientific ideas are. This endeavour is not just academic; it holds potential practical significance for science policy. Tools that help identify highly novel ideas have substantial potential to enhance our understanding of the factors that drive novelty and transformational research. Furthermore, this research paves the way for developing innovative tools designed to support peer review processes, streamline the detection of potentially highly novel ideas and help science funders monitor the novelty levels of their portfolio of investments. Such advancement can benefit the broader scientific landscape at several stages, such as project selection, publication processes, and science policy monitoring and evaluation.
The major innovation of this paper is the development of a “novelty vector”. Consequently, the central hypothesis for testing is whether the vector manages to learn from expert reviews and predict novelty using a unique dataset of successful and unsuccessful scientific proposals and their expert review scores. This vector stems from a new type of data exploration using textual embeddings. Embeddings are a form of textual representation originating from machine learning and natural language processing disciplines, which captures semantic meaning based on the context in which textual items appear in large corpora. Embeddings translate words, phrases or documents into vectors of real numbers. These vectors fit a multi-dimensional space such that documents with similar meanings or contexts point at similar directions, while those with distinct meanings are further apart.
Wang, J., Veugelers, R., & Stephan, P. (2017). Bias against novelty in science: A cautionary tale for users of bibliometric indicators. Research Policy, 46(8), 1416–1436. https://doi.org/10.1016/J.RESPOL.2017.06.006 OECD (2021), "Effective policies to foster high-risk/high-reward research", OECD Science, Technology and Industry Policy Papers, No. 112, OECD Publishing, Paris, https://doi.org/10.1787/06913b3b-en. Machado, D. (2021), "Quantitative indicators for high-risk/high-reward research", OECD Science, Technology and Industry Working Papers, No. 2021/07, OECD Publishing, Paris, https://doi.org/10.1787/675cbef6-en. Franzoni, C., & Stephan, P. (2023). Uncertainty and risk-taking in science: Meaning, measurement and management in peer review of research proposals. Research Policy, 52(3), 104706. https://doi.org/10.1016/J.RESPOL.2022.104706
Identifying highly novel research proposals: evaluation of the selection process of the Austrian Science Fund Emerging Fields programme
ABSTRACT. Background and rationale
In cases of schemes with multiple aims and multiple assessment criteria, process evaluations face the challenge of having to assess to what extent application selection processes consider and reward these various aspects of proposed research projects.
Moreover, recent years have seen a proliferation of modifications to the long-established standard assessment process for research grants (typically external peer review followed by expert panel review using standard criteria around research quality and feasibility) (Sivertsen & Langfeldt, 2025). These include short pre-proposals, inclusion of non-academic reviewers or panellists, in-person presentations.
The Austrian FWF’s Emerging Fields (EF) programme aims to fund collaborative research teams to conduct pioneering basic research that departs from established approaches. It aims to give researchers the opportunity to pursue particularly innovative, original, or high-risk ideas. One of the problems with peer review is that proposals based on established knowledge and methods tend to do better than those that include pathbreaking new methods often associated with risk (but potentially also higher rewards) (Langfeldt, 2006). There is evidence that reviewers tend to favour proposals in their fields that align with their ways of thinking, and the more interdisciplinary a grant proposal is, the slimmer its chance of success (Bromham, 2016). Peer review can be biased towards well-recognised names (Jones, 2022) and institutions; there is also some evidence of gender bias (Mutz et al, 2015). The study had to identify whether the EF programme review processes suffer from these biases.
The EF scheme has two separate written application assessment stages: a short outline-proposal stage, followed by a full application review stage. Background research on the scheme’s design led us to a hypothesis that reviews in the first of these two stages should emphasise and reward innovative potential and novelty of the proposed project ideas, while reviews in the second stage should place a greater emphasis on scientific quality of the research plans.
Prominent international scientists reviewed the stage-1 synopses and stage-2 full proposals for the EF programme and produced evaluation documents detailing their judgements. In total, we had access to 140 records: 87 peer-reviews of synopses and 53 reviews of full proposals. Given the number, heterogeneity and complexity of the review documents, generative AI was particularly useful in facilitating a systematic assessment (Kolarz et al, 2024).
Data and methods
We used generative AI to analyse peer reviewers’ reports on applications submitted to the FWF’s Emerging Fields (EF) programme.
We used a rich and comprehensive generative AI model that managed to navigate these technical details to find relevant individual insights about each review document and stylised facts about the selection process in its two stages.
The model was OPENAI's latest GPT4 large language model accessed programmatically via a dedicated API.
We performed topic detection, sentiment and priority detection analyses, exploring the text of the review documents from both the first and second assessment stages with generative AI. The topic detection consisted of distinguishing the parts of the reviews focusing on novelty, risk, scientific quality and team suitability dimensions. The sentiment analysis assessed whether the reviewers were positive, negative or neutral on their considerations about each topic. Finally, the priority detection measured the text length or number of words dedicated to each topic as a proxy for how much effort/time the reviewers devoted to each dimension.
Findings
Our results provide evidence in favour of our main hypotheses, most notably with novelty having a significantly higher priority at stage-1 and scientific quality having a significantly higher priority at stage-2.
The analysis of priorities confirms that at the synopses review stage, reviewers focus more on the novelty dimension and less on considerations about scientific quality. Our ranking indicator ranges from 0 to 3, with novelty scoring, on average, 2.26 for stage-1 synopses and only 1.25 for stage-2 full proposals. The ‘risk’ and ‘team’ dimensions also receive more attention at the synopses stage than proposals, but with less pronounced differences. The differences in terms of dedication to reviewing scientific quality are more noticeable. This dimension has the lowest rank at stage-1, scoring on average 0.61. In contrast, scientific quality considerations rank the highest at stage-2, scoring 2.19.
The findings align with other methods used in the study. Jury members we interviewed frequently commented on the high level of novelty of the synopses they reviewed (and subsequently on the presentations at the Stage 3 Jury hearings). Of our Stage 2 peer reviewers surveyed, around 60% judge the EF application they reviewed to have a higher level of novelty than what they would consider the norm, splitting roughly equally between the ‘slightly’ and ‘significantly’ answer options.
Significance
As documented (OECD, 2021), one central challenge science policymakers face is applicants’ fear that their ideas are too ambitious and risky. Scientists’ fear of following risky ideas is the initial challenge in promoting breakthrough science because, regardless of other potential sources of bias against novelty, breakthrough discoveries are unlikely to emerge without a pool of novel scientific ideas to choose from. Our results suggest that the EF programme was able to convince the scientific community to think outside of the box and submit highly novel ideas for funding.
The methodological significance of the work lays in the use of generative AI to add to the mix of evidence and triangulate across the sources to provide more insightful, comprehensive and robust findings.
References
Bromham L., Dinnage R., Hua X. (2016). Interdisciplinary research has consistently lower funding success. Nature 534 (7609), 684–687.
G. Sivertsen, L. Langfeldt (eds.) (2025). Challenges in Research Policy, SpringerBriefs
in Political Science, https://doi.org/10.1007/978-3-031-69580-3_5
Jones N. (2022) Authors' names have 'astonishing' influence on peer reviewers. doi: 10.1038/d41586-022-03256-9. Epub ahead of print. PMID: 36220906.
Kolarz, P., Vingre, A., Machado, D., Sutinen, L., Dudenbostel, T., & Arnold, E. (2024). Accompanying process evaluation of FWF's Emerging Fields. Zenodo. https://doi.org/10.5281/zenodo.13911479
Langfeldt, L. (2006). The policy challenges of peer review: managing bias, conflict of interests and interdisciplinary assessments. Research evaluation, 15(1), 31-41.
OECD (2021), "Effective policies to foster high-risk/high-reward research", OECD Science, Technology and Industry Policy Papers, No. 112, OECD Publishing, Paris, https://doi.org/10.1787/06913b3b-en.
Funded and unfunded science in Russia: A new dataset and longitudinal analysis
ABSTRACT. Background
While funding is a critical driver of scientific progress, it remains unknown whether and to what extent certain scientific topics are unfunded. There is increasing interest in making the historically hidden scientific funding process more transparent [1], but research is limited because data about unfunded grant proposals is difficult to get access to. The few studies that analyze unfunded proposals focus on the U.S., e.g. [2], and tend to analyze a single cross-section in time, rather than comparing how unfunded topics at an agency change over time. Russia in particular is an interesting case to study how politics and national strategies may influence scientific funding given the identifiable sociopolitical changes over the past 30 years, offering unique insights relevant for understanding the political nature of scientific funding worldwide.
Data & Methods
Here, we introduce a new dataset of 326,661 supported and rejected grant applications submitted to the Russian Foundation for Basic Research (RFBR) from 1994-2016, spanning eight disciplines (Biology & Medical Sciences, Chemistry & Material Sciences, Earth Sciences, Engineering, Humanities & Social Sciences, Information Technology, Math & Computer Science, and Physics & Astronomy). The RFBR represents roughly 50% of government funding for science in Russia. Our dataset is one of the largest and most comprehensive of its kind, allowing us to advance the study of the scientific funding process in two main ways: (i) by including rejected applications, and (ii) by analyzing funding dynamics over time. Combined, these contributions expand our understanding about what knowledge might be suppressed by the funding process and characterize the tension between scientific autonomy and governmental agenda-setting.
We constructed the dataset using web-scraping and Russian language assistance from an expert. We scraped each submitted project to the RFBR including the year, title, field, competition, and status (accepted or rejected). We removed duplicates, projects with missing data, and competitions that did not directly fund research (e.g., a competition for conference participation).
Inequities in funding outcomes likely vary by gender and academic experience. In our dataset, we estimated the gender of each applicant using algorithmic name-based gender associations. We estimated the academic experience of each applicant from information about the funding competitions by age (max) and number of publications (min). For example, one early-career competition required applicants to be under age 35 and have more than two recent publications. Our dataset has suitable statistical power to assess differences between subgroups (e.g., women in a given field and year who were funded versus men).
Preliminary Results
Scientific understanding of how funding agencies influence what science gets done has been limited by difficulties in accessing funding data, particularly unfunded proposals. This project helps overcome this limitation and greatly advances our understanding of which scientific topics are funded by (i) characterizing the disciplines of funded and unfunded grant proposals, (ii) comparing how over- and under-funded disciplines vary across researchers with different characteristics (gender and academic experience), and at several levels of analysis: overall, cross-field, and within-field, and (iii) identifying how political changes over time impact the disciplines that are funded or not.
Our dataset is uniquely posed to answer these questions because it includes rejected proposals over a long period of time. We analyze time at two separate levels—annually and by sociopolitical period. We constructed three distinct time periods to assess how funding has changed with the cyclical patterns of governmental control in Russia: (i) 1994-2004: Relatively weak state control and low funding, (ii) 2004-2014: Relatively weak state control and explosive growth of funding, and (iii) 2014-2016: Increased state control and continued high funding.
We find substantial gender differences in funded versus unfunded proposals, which vary by discipline. In fact, in almost every field, women’s grants are significantly less likely to be accepted than men’s, with the largest gender gap in information technology proposals. Further, the gender gap in most fields has been growing over time. This could be in part due to shifting state funding priorities over time, with physics and astronomy funding decreasing and engineering and information technology funding increasing starting in 2005, concurrent with the sudden growth of funding in Russia. Finally, we found that women in all fields were more likely to both apply to and receive early-career low-experience awards, however, in Russia these grants are smaller and less prestigious than other grants.
These descriptive statistics alone are powerful given the dearth of data on rejected proposals. But are there differences in the specific research topics that are rejected over time within each field? To find out, we use state of the art topic modeling approaches to characterize the topics among supported versus rejected proposals. We keep the text in Russian and use BERTopic Russian fine-tuned models. Our preliminary results show that the topics that are supported versus rejected differ in the language structure they use across fields.
Significance
This project develops an underexplored area in science policy and provides a foundation for policymakers and funding agencies globally to interrogate and improve their practices. For instance, recognition of consistently underfunded topics would impact priority setting at funding agencies. Understanding what science is being proposed but isn’t being done due to the structure of funding will also have implications for the public and researchers. Identifying topics of societal importance that are systematically unfunded could increase socially relevant scientific discoveries. Researchers would benefit from increased transparency in the funding process and greater attention to diversity and fairness. Finally, releasing this new dataset will be extremely valuable for scientists and policymakers interested in understanding and improving scientific funding processes. These results will provide new frameworks to advance research in science and innovation policy, sociology of science, and political science. This abstract demonstrates the analyses that are possible with our data, opening up new directions for future research and new hypotheses.
References
1. Horbach, Tijdink & Bouter. (2022). Research funders should be more transparent: A plea for open applications. Royal Society Open Science, 9(10), 220750.
2. Taffe & Gilpin. (2021). Racial inequity in grant funding from the US National Institutes of Health. Elife, 10, e65697.
From Bean Counting to Game Changing: Rebalancing Research Funding in the Era of Digital Transformation
ABSTRACT. Research Background
While the influence of New Public Management (NPM) has waned in many areas of public administration, its principles continue to dominate research funding allocation across many countries. This persistent influence is evident in several trends: the growing emphasis on competitive project-based funding over institutional block grants, the increasing use of quantitative performance metrics in funding decisions, and the widespread adoption of market-like mechanisms in research resource allocation. The NPM doctrine has fundamentally shaped how research is funded, as particularly visible in the proliferation of performance-based funding systems and the growing administrative burden of grant applications and reporting requirements.
This continued dominance of NPM principles in research funding has become especially problematic in the era of platform-based and networked science. Modern scientific research increasingly relies on large-scale research infrastructure, real-time data sharing, and complex collaborative networks that transcend institutional and national boundaries. These characteristics fundamentally conflict with NPM's emphasis on competition, clearly defined deliverables, and short-term performance metrics. This misalignment discourages risk-taking in emerging fields, hampers the development of sustainable research infrastructure, and creates barriers to fluid, cross-institutional collaboration necessary for advancing contemporary science.
Research Questions
This study addresses five interconnected research questions. First, how do platform-based and networked characteristics of modern science challenge the NPM-influenced balance among different research funding mechanisms? Second, what institutional factors explain the persistence of NPM principles in research funding despite their apparent limitations? Third, how do varying levels of governance quality affect the optimization of funding mechanisms across different countries? Fourth, what innovative approaches are emerging to reconcile accountability requirements with the needs of networked research? Finally, how can funding mechanisms be recalibrated to better support platform-based science while maintaining necessary oversight?
Research Methods
This study develops an analytical framework integrating institutional theory, transaction cost economics, and innovation systems theory to examine how funding mechanisms align with demands of platform-based and networked science. The framework analyzes three key dimensions: funding mechanism balance (distribution among block grants, individual funding, and project funding), governance quality (transparency, efficiency, and accountability), and platform/network characteristics (infrastructure requirements, collaboration patterns, and data sharing needs).
The research employs a comparative case analysis of five major research economies (the United States, Germany, Japan, the United Kingdom, and China), selected for their varying balances of funding mechanisms and different approaches to research governance. Our analytical strategy combines four methods. First, historical analysis traces the evolution of funding mechanisms (2000-2024) through systematic documentary analysis of national research funding policies, funding agency annual reports, program documentation, and reform proposals. Second, quantitative analysis examines funding allocation patterns, including the distribution across mechanisms, trends in allocation, and relationships with research outputs. Third, institutional analysis investigates governance structures, funding program designs, and evaluation systems through detailed examination of institutional documents and program guidelines. Fourth, cross-national comparison systematically examines variations in funding approaches and their outcomes across different national contexts.
Data collection focuses on three main sources. The primary dataset comprises documentary evidence including national research strategies, funding agency policies, program evaluations, parliamentary/congressional reports, and institutional guidelines. This is supplemented by quantitative data on funding allocations, research outputs (publications, patents, collaborative projects), and infrastructure investments. Additionally, selective expert interviews will help validate and interpret findings from documentary and quantitative analysis. The data will be analyzed using a comparative matrix examining relationships between funding mechanisms, governance structures, and research outcomes across different national contexts.
Expected Findings
Drawing from our integrated analytical framework, the comparative analysis is expected to reveal several key findings. First, institutional theory would help explain why countries with strong governance structures but different institutional traditions (like the US and Germany) have evolved distinct hybrid funding models that depart from pure NPM principles. Second, transaction cost analysis is likely to demonstrate how different types of research platforms and networks require distinct funding configurations - with research involving shared infrastructure and extensive collaboration showing higher transaction costs under traditional competitive funding. Third, innovation systems analysis would reveal how the effectiveness of funding mechanisms depends on the alignment between governance arrangements and research infrastructure requirements, with better-aligned systems demonstrating higher innovation outputs and stronger collaborative networks. These findings collectively suggest that the optimal balance of funding mechanisms varies with institutional contexts and research characteristics.
Theoretical and Practical Contributions
This research advances both theoretical understanding and practical knowledge of research funding mechanisms. Theoretically, it extends institutional and transaction cost theories by explaining how platform-based and networked science creates new organizational demands that challenge traditional NPM principles. The integrated analytical framework developed in this study provides a novel approach for analyzing the alignment between funding mechanisms and research characteristics in different institutional contexts. Practically, this research offers evidence-based guidance for policymakers on optimizing the balance between funding mechanisms based on institutional conditions, governance capacity, and research infrastructure requirements. These insights can help funding bodies design more effective funding portfolios that support contemporary scientific collaboration while maintaining appropriate accountability measures.
An impact assessment strategy for biomedical research funding
ABSTRACT. Research funding agencies have a unique role in the research ecosystem. By providing the financial support necessary for research to be conducted, funders provide the foundation on which the research ecosystem is built and help shape the directions, processes, and policies though which research is conducted. But because most funders distribute funds collected from external sources, funders are consistently asked to demonstrate that they are responsible stewards of the funds they manage and that the research conducted with those funds produces tangible benefits to society. Funders therefore need comprehensive and actionable strategies for assessing the impact of the research they support.
In this proposal, I present an overarching framework proposed for assessing biomedical research impact at the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), one of the 27 Institutes and Centers comprising the US National Institutes of Health (NIH). The framework currently consists of three components: a logic model of NICHD operations, a suite of associated indicators, and a data collection and analysis approach for generating these indicators. Although developed specifically for NICHD, the strategy is adaptable for other biomedical funding agencies.
The first component in the strategy is a logic model depicting the inputs, outputs, short-term outcomes, and long-term outcomes of all project types supported by NICHD. In the model, investigators use knowledge and resources to apply for various types of project funding. Awarded projects then produce outputs like knowledge, people, and products. Those outputs then lead to a series of short-term research outcomes like an informed research community and a diverse and skilled workforce and short-term health outcomes like new or improved treatments and better health behaviors. Finally, these short-term outcomes lead to NICHD’s long-term outcomes of producing new research and improving human health. In this framework, impact is envisioned as a series of connections, or pathways, through the model. Impact can therefore be achieved in multiple ways through multiple channels depending on the type and goals of each project. Impact for a training project will be different than impact for a research project because the goals and intended impact pathways are different, but both pathways ultimately lead to NICHD’s long-term outcomes of new research and improved health.
The second component in the strategy is a suite of quantitative indicators that indicate progress through the model. For example, article-to-article citations indicate that knowledge produced by a project informed the research community and was then used to produce new research. Trainees actively publishing in the academic literature indicate that people joined the research workforce and are now contributing to the production of new research. Article citations in patents and policy documents indicate that scientific discoveries resulted in new technologies, treatments, and/or policies that can improve health. A range of indicators are therefore needed to capture the myriad impact pathways depicted by the model, and different indicators are needed for different impact pathways. These quantitative indicators will be complemented by qualitative inputs like case studies and impact stories to maximize comprehensiveness and minimize bias.
In the strategy, these indicators will be used to assess large funding programs and to identify significant research and health outcomes but will not be used to assess individual projects or investigators. Following Thomas Kuhn, the strategy considers significant research impacts to be rare occurrences that resist aggregation. Aggregate impact measures imply that every research output produced should be impactful – that every publication, trainee, or product should change the world – which is neither realistic nor fair. Most scientific research results in incremental advances that collectively enable substantial, groundbreaking discoveries to be made. From this perspective, specific investigators or specific projects rarely change the world, so they should not be expected to do so. Nor should anyone expect every research output they produce to do so. Instead, the proposed indicators will be used as signals that significant research or health outcomes may have occurred at a specific time and place.
Since NICHD supports over 3000 projects per year, the third component in the strategy, the data collection approach used to generate these indicators, will rely heavily on automated scripts and application programming interfaces (APIs). These processes will typically begin with funding data collected from NIH administrative data systems like RePORTER. A series of APIs will then be used to collect data on outputs like people, publications, patents, etc. resulting from NICHD funding and then collect outcome data like citations in various document types that are associated with those outputs. Finally, analysts will identify findings, projects, or programs with high outcome measure values as candidates for in-depth follow-up. Investigator-supplied progress reports and program staff nominations will be used to supplement and validate the indicator-derived findings. Finally, analysts will collaborate with program staff to write impact narratives for the significant results or programs that describe the context, results, significance, and NICHD involvement for each one.
This proposed strategy is currently under review by NICHD leadership and staff. The strategy proposes substantial philosophical and operational changes to how impact is currently assessed at NICHD, so if it were to be adopted, it would take time for these processes to be implemented and for stakeholders to adjust. But I hope its benefits will be worth the cost. By shifting impact assessment away from individuals and projects, the strategy aims to reduce pressure on NICHD’s funded investigators to demonstrate the productivity and significance of their work, allowing them to focus more on the work itself. And by expanding the definition, and partially automating the process of identifying, impact, it also aims to enable NICHD to identify, communicate, and celebrate more of the life-changing research that it supports. NICHD funding supports the research enterprise and saves lives. I hope the proposed strategy helps it tell that story.
Risk-taking and research funding - the case of the Villum Experiment
ABSTRACT. Risk and risk-taking in science and their relation to creativity and novelty in research results have received increasing attention in recent years (Franzoni and Stephan 2023). In particular, many have argued that researchers lack incentives to engage in risky research (Franzoni et al. 2022, Alberts et al. 2014). For example, institutional conditions are argued to work against risk-taking (Heinze 2013, Lee and Walsh 2022, Stage and Utoft 2023), including performance assessment based on number of publications, employment in short-term positions, reliance on competitive research funding, and conditions for advancement.
Particular focus has been placed on risk-taking in the allocation of competitive funding and peer review of research grant proposals (Franzoni and Stephan 2023, Carson et al. 2023). Both the way in which researchers perceive these review processes to function and reviewers’ and funders’ willingness to fund risky research can have important impacts on what research is funded and its novelty.
As also noted by Franzoni and Stephan (2023), despite this focus, there is a lack of clarity about what risk-taking in science is and how it is perceived. There may also be multiple types of outcomes related to research, such as for careers, funding and ethics, suggesting that risk should not be seen solely in terms of scientific outcomes. Risk-taking in science can also be seen from a number of different perspectives, most notably from that of funders, reviewers and researchers. Each group has their own set of factors that can determine what risk-taking is but are closely influenced by how risk-taking is perceived by other actors.
This paper seeks to examine the following questions. How is risk and risk-taking perceived by researchers? What strategies do researchers use to address uncertainty in a funding program that promotes originality? The analysis is based on grant recipients from the Villum Experiment Programme . This program, which is funded by the Villum Foundation in Denmark, supports projects exploring original research ideas that are out of the ordinary, challenge established norms within one or more fields, and could potentially change the future scientific approach to a given topic (Sinkjær 2018).
The analysis draws on semi-structured interviews with 24 Villum Experiment grant recipients in 2017 or 2018. The interview guide encompassed five categories of questions: the recipient, their perceptions of the funding instrument, the applied for research plans, the research process and outcomes.
Our study indicates, on the one hand, all appeared to perceive that risky applications would be positively received by the program and most though not all researchers actually designed projects that had greater risk than their research in general. Researchers’ perceptions of the VE program and of how applications are assessed appeared to influence how they wrote their VE project applications and how the projects were conducted. Importantly, on the other hand, we also find many examples of how conditions within the Danish research system influenced risk-taking even in a program such as the VE, particularly concerning the potential consequences for career paths or performance evaluation.
Grantees expressed risk in a number of different ways, typically not in one single way, such as in terms of chances of success, uncertainty due to use of new methods or equipment or a new research area. Risk was also expressed in terms of uncertainty concerning how long it would take to conduct planned research experiments. Outcomes were typically referred to in terms of publication potential: possible number of publications that the research could produce or risk of not being able to publish anything and the level of journals that could be reached.
While scientific outcomes were often expressed in terms of publication potential, researchers were mainly concerned with potential career-related effects of a negative scientific outcome on future job opportunities, particularly for temporarily employed postdocs, or in some cases their chances of securing subsequent funding. In particular two related strategies were employed to “hedge” project risk on behalf of postdocs hired for the projects. The first was to ensure that no participants worked only on the VE project, that VE participation was balanced with participation in another research project with more certain outcomes. The second was to divide the VE project into two parts, where the first part had a certain outcome (in some cases, a literature review) and the second part was experimental with uncertain outcomes.
References
Alberts, Bruce, Marc W. Kirschner, Shirley Tilghman, and Harold Varmus. 2014. “Rescuing US Biomedical Research from Its Systemic Flaws.” Proceedings of the National Academy of Sciences 111 (16): 5773–77. https://doi.org/10.1073/pnas.1404402111.
Carson, R. T., Zivin, J. S. G., and Shrader, J. G. (2023). Choose your moments: Peer review and scientific risk taking (No. w31409). National Bureau of Economic Research.
Franzoni, C., Stephan, P., and Veugelers, R. (2022). Funding risky research. Entrepreneurship and Innovation Policy and the Economy, 1(1), 103-133.
Franzoni, C., and Stephan, P. (2023). Uncertainty and risk-taking in science: Meaning, measurement and management in peer review of research proposals. Research Policy, 52(3), 104706.
Heinze, T. (2013). Creative accomplishments in science: Definition, theoretical considerations, examples from science history, and bibliometric findings. Scientometrics, 95, 927-940.
Lee, Y. N., and Walsh, J. P. (2022). Rethinking science as a vocation: One hundred years of bureaucratization of academic science. Science, Technology, & Human Values, 47(5), 1057-1085.
Sinkjaer, T. (2018). Fund ideas, not pedigree, to find fresh insight. Nature, 555(7697), 143-144.
Stage, A. K., and Utoft, E. H. (2023). Fun and less fun funding: the experiential affordances of research grant conditions. Science and Public Policy, 50(6), 1091-1102.
Why industrial policy needs directionalities and strategic foresight processes
ABSTRACT. Background and research questions
Germany and Europe face significant transformations. The automotive industry struggles to compete in the electric vehicle sector, while the chemical and steel industries demand clarity on energy prices and innovation funding. Additionally, German businesses must enhance their competitiveness in artificial intelligence applications. Despite the ecological transformation often being viewed as a burden, green technologies are essential for long-term competitiveness and economic prosperity. Relying on traditional technologies, such as combustion engines, risks an "innovation dilemma," securing short-term profits but losing out in the long run.
A proactive industrial policy is increasingly demanded to ensure prosperity, competitive-ness, and decarbonization amid technological and geopolitical shifts. This policy must balance horizontal measures, like energy pricing, with vertical support for specific sec-tors. Absolute technological neutrality is neither feasible nor desirable. Early-stage open-ness to diverse technologies should eventually lead to clear prioritization to align infra-structure and investment. Germany must also respond to global shifts, such as the U.S. Inflation Reduction Act, by defining strategic priorities and fostering key sectors.
Facing these challenges of industrial policy making in Germany and Europe, recent dis-cussions on dynamic capabilities of the state towards mission-orientation highlight state capacities as necessary condition. But what kind of capacities governments and admin-istrations need to learn and use for industrial policy making? While the necessity of dy-namic capabilities, strategic intelligence and anticipatory governance ae acknowledged by an increasing number of states, international organizations and public administrations, questions emerge in regard to their concrete institutionalization. Current research on institutionalizing strategic foresight shows how to analyze and support the adaption of forward-looking reflexive policy practices(Priebe et al. 2024). Despite clear links to the challenges in industrial policymaking, there is a surprising lack of research on the appli-cation of foresight in this policy domain, notably for the translation of industrial strategies to an (adaptive) industrial policy mix. Thus, we are rising the research question on what kind of state capacities governments and administrations need to conduct industrial poli-cies and how strategic foresight contributes to that.
Methodology
By reviewing the literature on industrial policy making for strategies and mixes of horizon-tal and vertical instruments, we deduced the main principles to conduct a rational indus-trial policy. Moreover, based on the foresight literature on technological and strategic foresight, we created a foresight process for the analysis of scenarios, the deduction of industrial policy objectives and the choice and design of industrial policy instruments. We are currently starting several workshops with policy makers at the federal or federal state level in Germany to test this process and to learn how from a practitioners’ perspective industrial policy making need to be discussed and conceptualized.
Literature Review: Principles for effective industrial policy
Industrial policy thrives on clear goals and societal integration, balancing broad participa-tion for practical solutions with the risk of excessive lobbying. For example, transforming heating systems requires combining societal input with expert guidance. While industries like automotive benefit from top-down directives (e.g., prioritizing electromobility), sectors like heating need participatory approaches to identify viable technologies for varied needs.
Clear direction is vital. The state must provide coherent signals about future markets and phase-outs, such as transitioning to renewables or vehicle electrification. Credibility relies on aligning ambitious targets (e.g., renewable energy) with necessary infrastructure, while addressing urban and rural differences like charging stations or district heating.
A balanced mix of financial, regulatory, and informational instruments is crucial. Financial incentives foster innovation by reducing risks, while regulations establish clear market rules. Informational measures, like campaigns or data collection, address knowledge gaps, as seen in the heating transition. Local and regional dynamics require collaboration across governance levels, from municipal planning to European energy integration.
Timing and flexibility are key. Industrial policy must anticipate technological and geopolit-ical shifts and allow adjustments. For example, delayed photovoltaic subsidy reforms caused high costs, highlighting the need for adaptable, scenario-based planning. Policies must ensure readiness, enabling households and industries to adopt sustainable tech-nologies without excessive strain.
Finally, accountability ensures legitimacy. Clear, measurable goals and transparent pro-gress reviews foster adaptability, support public acceptance, and enhance policy evolu-tion.
Preliminary results: Design of a strategic foresight process for industrial policy
Industrial policy must identify the key core sectors of Germany’s current economy, de-fined by their significant contribution to GDP, employment, or regional economic struc-ture. Future sectors extend these core sectors over a 20-year horizon, potentially evolv-ing from existing ones or emerging as new fields, such as the hydrogen economy. Addi-tionally, strategic sectors, like medical protective equipment, defense, semiconductors, or other critical intermediate goods, are vital for geopolitical reasons, even if they contribute less to GDP. Ensuring sufficient production of these sectors in Germany or Europe is a strategic necessity.
Identifying relevant sectors involves significant uncertainty. The evolution of technolo-gies, socio-economic conditions, and geopolitical factors determines which sectors are considered future or strategic. Strategic foresight analyzes these possibilities through internal workshops or broad participatory processes. Society must adapt to various sce-narios and understand industrial policy adjustments.
Scenarios outline potential futures based on key influencing factors, such as geopolitical conflicts, EU cohesion, technological developments, or shifting societal priorities. Once developed collaboratively, these scenarios guide discussions on which sectors are rele-vant in different contexts. They also inform industrial policy goals. If a future sector ap-pears in all scenarios, robust strategies should focus on its promotion as a "no regret" option. Conversely, sectors relevant in specific scenarios should be supported with flexible policies accommodating changing priorities.
From these largely narrative scenarios, indicators can be derived to analyze which scenario aligns with current realities. Regular monitoring helps implement scenario-specific strategies, prioritize instruments, and adjust goals as needed. If trends indicate a shift toward another scenario, policymakers can preemptively evaluate affected sectors, abandon outdated goals, and prioritize new measures.
By integrating foresight, monitoring, and flexibility, industrial policy can navigate uncer-tainty, foster innovation, and maintain societal and economic resilience, aligning strategies with evolving geopolitical, technological, and ecological landscapes.
Overlooked Maintenance: The Impact of Competition and Free-Riding on the Reliability of U.S. EV Charging Infrastructure
ABSTRACT. The prevailing emphasis on technological innovation often overshadows the critical importance of maintenance and repair in improving infrastructure reliability and sustainability. This innovation-centric mindset, as critiqued by maintenance theorists, leads to systemic vulnerabilities in technological systems due to the undervaluation of upkeep activities. In the context of electric vehicle (EV) charging infrastructure, this oversight manifests as declining operational reliability and quality, despite significant investments aimed at expanding the network to combat climate change.
This study examines the deteriorating reliability of EV charging stations in the United States amidst substantial federal investments, such as the Biden administration’s $7.5 billion allocation for building a national charging network. While the expansion of charging infrastructure is crucial for promoting EV adoption and reducing carbon emissions, the maintenance of these stations remains inadequately addressed. The reliability issues not only hinder user experience but also pose a significant barrier to EV adoption due to indirect network effects, where the value of the network depends on the reliability of its components.
Drawing on the theoretical framework that highlights the overlooked significance of maintenance, this research investigates how nearby service density influences the operational reliability of EV charging stations. Specifically, it explores two competing mechanisms:
1. Competition Incentivizing Maintenance: Greater competition from nearby stations may incentivize hosts -- especially those generating revenue directly from charging services -- to maintain high reliability to attract and retain customers. This aligns with the notion that when maintenance directly impacts revenue, it becomes a prioritized activity.
2. Free-Riding Leading to Maintenance Neglect: Conversely, an increased density of nearby stations may lead some hosts, particularly those for whom charging is a supplementary service, to rely on others to provide reliable service. This results in underinvestment in maintenance due to the diffusion of accountability -- a phenomenon observed in broader maintenance neglect patterns.
Existing research on competition and free riding primarily focuses on the service providers within the same industry offering the same core service. There is a lack of studies examining competition in the context of core versus supplementary services, where providers of the same primary business are differentiated from those of different primary businesses. The study formulates two hypotheses to test these mechanisms:
H1: An increase in the density of nearby same-industry service providers leads to higher station reliability, especially for core service providers.
H2: An increase in the density of nearby different-industry service providers leads to lower station reliability for supplementary service providers.
To empirically investigate these hypotheses, a comprehensive panel dataset of U.S. charging stations from 2011 to 2024 was compiled from multiple sources. The nearby service density was measured as the number of stations within a 1-mile radius of each station, with robustness checks conducted using radii from 0.2 to 5 with a step of 0.2. Charging reliability was quantified by analyzing consumer reviews from EV charging locator apps, focusing on the percentage of reviews mentioning reliability issues. Advanced natural language processing techniques, including fine-tuned BERT and GPT models combined with chain-of-thought prompting, were employed to classify relevant user feedback accurately.
A fixed-effect lagged panel regression model was used to control for unobserved heterogeneity and to capture the dynamic effects of nearby service density on station reliability over time. The descriptive analysis revealed a concerning trend: the reliability of EV charging stations across the U.S. has been steadily declining each year, falling significantly below the expected 97% uptime mandated by federal policy.
The regression results supported the proposed hypotheses. Specifically:
H1 confirmed: An increase in the density of nearby same-industry service providers leads to higher station reliability, especially for core service providers. For core stations, a 100% increase in the prior year’s density of nearby stations of the same business type is associated with a 6.93-point increase (10.77% increase) in the reliability score. This suggests that competition incentivizes these hosts to invest in maintenance to attract customers, reinforcing the theoretical perspective that maintenance becomes prioritized when directly tied to revenue generation.
H2 confirmed: An increase in the density of nearby different-industry service providers leads to lower station reliability for supplementary service providers. These hosts appeared to engage in free-riding behavior, underinvesting in maintenance with the assumption that nearby stations would compensate for their lack of reliability -- a manifestation of the diffusion of maintenance responsibility.
These findings underscore the limitations of relying solely on market forces to ensure the reliability of critical infrastructure. The observed maintenance neglect aligns with the theoretical critique that innovation-centric policies often fail to address the essential work of upkeep, leading to systemic inefficiencies and user dissatisfaction.
The study highlights the necessity for policy interventions to address the maintenance gap in EV charging infrastructure. This work demonstrates that the market is under-providing service quality, highlighting the need for policy interventions. Greater funding and incentives should be directed not only towards building new chargers but also towards maintaining and inspecting existing ones. The government must establish clear accountability for reliability standards, such as enforcing a minimum operational threshold (e.g., 97% uptime). In the long run, R&D investment should be encouraged to develop more durable and resilient charging equipment.
By integrating the theoretical insights on the undervaluation of maintenance, this study illuminates a critical gap in the current approach to EV infrastructure development. The declining reliability of charging stations, exacerbated by inadequate maintenance practices, poses a significant barrier to EV adoption and undermines efforts to combat climate change. Recognizing maintenance as a fundamental component of technological systems is essential for achieving long-term reliability and fostering user trust in EV charging networks and therefore increasing the adoption of EV and other clean energy products.
This research contributes to the broader literature on the importance of maintenance in technological systems and offers practical policy recommendations to enhance the reliability of EV charging infrastructure. Addressing the maintenance gap is imperative not only for the success of EV adoption but also for ensuring the sustainability and resilience of critical technological infrastructures in the face of growing environmental challenges.
ABSTRACT. Climate change and environmental degradation are making increasingly urgent a green transition towards an economy where human-produced greenhouse gas emissions are reduced to (net) zero, and natural resources are used more efficiently. The green transition has become a prominent focus of policy across the globe and particularly in Europe, where it has been recently associated with the digital transformation. Starting from the new EU Industrial Strategy (European Commission, 2020), and moving towards the new Green-Deal Industrial plan (European Commission, 2023), the “green and the digital challenges” have been claimed to merge into a “twin transition”, in which digitalisation serves to enhance environmental sustainability (JRC, 2022).
However, amidst the recent surge in policy recommendations advocating for this twin transition, concerns regarding its territorial distribution across regions have arisen. On the one hand, regions are shown to have different greening capacity (e.g. Barbieri et al., 2020) and to face different direct (e.g. phasing out of brown energy) and indirect (e.g. reallocating labour from brown to green occupations) costs in moving along the green transition (Rodrıguez-Pose & Bartalucci, 2023). On the other hand, digitalisation also unfold irregularly across places, revealing regional gaps in the development, adoption and exploitation of new digital technologies (e.g. Corradini & De Propris, 2017). In light of that, the combination of the two transitions can also be expected to differentiate across regions, rendering the investigation of its geography of paramount importance.
Research on the geography of the twin transition is still thin, but fast growing (e.g. Faggian et al., 2014). In geography of innovation studies, the analysis on the twin transition phenomenon is carried out mainly to investigate the extent to which new digital and/or green technologies emerge from pre-existing regional technologies (e.g. Bachtrogler-Unger et al., 2023). In this paper, building on the recombinant theory of innovation, we delve into the nature and patterns of combining green and digital technologies, specifically examining the speed at which regions integrate these technologies. More precisely, we are interested in analysing how fast regions are capable to implement combinations of green and digital knowledge in their local inventions, compared to what happens at the frontier of the knowledge space. This aspect of the twin transition has not yet been addressed in literature. However, we consider it highly relevant given the urgent pressure from policymakers for regions to swiftly advance their combined green and digital transformations.
In our analysis, we examine two key aspects. First, we analyse how the speed of combining green and digital technologies is influenced by the characteristics of the relative regional knowledge, as well as by the nature of the combinatory patterns of the two kinds of technologies. This will be useful in identifying potential leverages that policy-makers can exploit to speed up the twin transition. Second, we investigate how the combination pace of green and digital technologies affects the impact of local twin inventions on the development of subsequent technologies. This aspect is also important to disentangle if the regions’ twin speed can affect their capacity of serving as reference for the development of new technological paradigms.
Using the European Patent Office (EPO) PATSTAT dataset, we build on previous patent-based research to identify green and digital technologies (Barbieri, 2016; Martinelli et al., 2021). We then define twin (green and digital) inventions based on the co-occurrence of digital and green (5-digit CPC) classes in patents (Kogler et al., 2013). These twin inventions are mapped across NUTS3 regions in 28 EU countries, covering the period from 1999 to 2019. We propose a novel measure of the average speed at which a region closes its gap in combining green and digital technologies relative to the frontier, that is, with respect to when the combination first takes place.
We find that the regional speed of combining green and digital technologies increases when the region has experience in dealing with diverse and complex twin-transition-related knowledge. Furthermore, we find that when the green and digital domains share common interdependencies, the speed of combination is higher. Third, the technological focus of the inventive teams, rather than their size, leads to quicker combinations. We discuss the counterintuitive evidence according to which faster combinations occur in case the technological distance is larger. This effect is explained by high density structures in the knowledge network, captured by a transitivity coefficient: intuitively, the longer the recombination path, the more are the opportunities to find short cuts that speed up twin combinations. As far as the impact of fast twin combination is concerned, we find that this is connected to a larger number of forward citations, only for granted patents.
References
References
Bachtrogler-Unger, J., Balland, P.-A., Boschma, R., & Schwab, T. (2023). Technological capabilities and the twin transition in Europe: Opportunities for regional collaboration and economic cohesion. Technical Report 117679, MPRA Paper
Barbieri, N. (2016). Fuel prices and the invention crowding out effect: Releasing the automotive industry from its dependence on fossil fuel. Technological Forecasting and Social Change, 111, 222–234
Barbieri, N., Perruchas, F., & Consoli, D. (2020b). Specialization, diversification, and environmental technology life cycle. Economic Geography, 96(2), 161–186
Corradini, C. & De Propris, L. (2017). Beyond local search: Bridging platforms and intesectoral technological integration. Research Policy, 46(1), 196–206.
European Commission (2020). A new industrial strategy for Europe
European Commission (2023). The European green deal industrial plan
Faggian, A., Marzucchi, A., & Montresor, S. (2024). Regions facing the ‘twin transition’: combining regional green and digital innovations. Regional Studies, 1-7.
Kogler, D. F., Rigby, D. L., & Tucker, I. (2013). Mapping knowledge space and technological relatedness in US cities. European Planning Studies, 21(9), 1374–1391
JRC (2022). Towards a green & digital future. Joint Research Centre (JRC), European Commission.
Martinelli, A., Mina, A., & Moggi, M. (2021). The enabling technologies of industry 4.0: examining the seeds of the fourth industrial revolution. Industrial and Corporate Change, 30(1), 161–188
Rodríguez-Pose, A., & Bartalucci, F. (2024). The green transition and its potential territorial discontents. Cambridge Journal of Regions, Economy and Society, 17(2), 339-358.
ABSTRACT. How does experimentalist governance affect firms innovation? What drives the world's largest oil and gas firms to invest in Carbon Dioxide Removal (CDR) technologies?
Public Policy scholars have recently put a lot of thinking into CDR and its techno-economic attributes as drivers of corporate engagement and investments (Battersby et al., 2022; Beaumont et al., 2022}. However, the early role of regulators in shaping the nexus between firms and innovation in CDR technology in the oil and gas industry has been largely neglected. This paper argues that early experimentalist CDR-related policies in the U.S. have shaped strategic corporate decisions, particularly in the realm of innovation and intellectual property. We center our argument on the regulatory drivers behind this innovative behavior in the context of high risks, uncertain returns, and the absence of a strong market for CDR (Sabel & Victor, 2022).
By fitting an Interrupted Time Series (ITS) model on patent data spanning from 1975 to 2024, this study reveals a notable shift in innovation activities among fossil fuel firms following the enactment of 45Q. Specifically, results ITS suggest an immediate effect of approximately 98 more patents per year across 50 firms after the year of policy enactment until 2024. In addition, using ARIMA model I forecast the counterfactual scenario—what the trend in patent filings might have looked like if the 2008 intervention had not occurred. By fitting the ARIMA model using pre-2008 data, I generate a forecast that helps to isolate the effect of the intervention. The main results suggest that without targeted regulatory incentives, fossil fuel firms are unlikely to prioritize or invest significantly in climate mitigation technologies.
This argument aligns with recent discussions on state experimentalist interventions and technology change, suggesting that government-led policies, driven by state interests, have initiated processes of policy learning and reductions in technology costs (Victor & Carlton, 2023; Breetz et al.,2018; Allan et al., 2021; Meckling, 2021). In the case of CDR, early policies in the U.S. aimed to redirect the technological focus of the largest oil and gas firms towards innovations in CDR. Oil and gas firms responded to early policies by increasingly applying for patents, reflecting a strategic alignment with the evolving regulatory landscape and the anticipated future significance of CDR technologies. As firms might expect that their assets will be reevaluated as existential risks from climate change become more prominent (Colgan et al., 2021), some view oil and has firms’ interest towards CDR as a (1) “mitigation deterrence” (Carton, 2023) or (2) as a way to shift the business model from production to removal of carbon.
For a "brown-to-green" transition to be successful, fossil fuel firms need to reorient their behavior toward decarbonization. State-led interventions must overcome entrenched market dynamics and strategic resistance from these firms.
In conclusion, this paper explores how early experimentalist policies, particularly the 45Q tax credit introduced in 2008, provided a unique regulatory push that incentivized U.S. fossil fuel firms to invest in CDR technologies. Despite facing initial challenges such as limited credit availability and uncertainty in allocations, 45Q emerged as a strategic tool for the government to address high-risk, capital-intensive solutions like CDR.
Can Synthetic Microdata Preserve Cross Product Moments of Innovation Phenomena?
ABSTRACT. Public use files (PUF) of federal survey microdata on individuals have been available for decades. However, large increases in computing power and the greater availability of Big Data have dramatically increased the probability of re-identifying anonymized data, potentially violating the pledge of confidentiality given to survey respondents. The same data science tools that increase the risk of disclosure can also be used to produce synthetic data that preserve critical moments of the empirical data but do not contain the records of any existing individual or business respondent. These synthetic data tools open new possibilities for producing microdata that will allow producing informative descriptive or multivariate analyses using PUFs that currently require access to confidential microdata. Developing public use establishment data from surveys presents unique challenges from demographic data, because there is a lack of anonymity and certain industries can be easily identified in a given geographic area. The presentation will briefly describe an algorithm used to construct a synthetic public use file based on the 2007 Survey of Business Owners. Although not an innovation survey, SBO does include several innovation adjacent variables that are useful for testing the verisimilitude of synthetic data with respect to innovation phenomena. Logistic regression and a Heckman selection model are applied to both the ground truth 2007 SBO and synthetic data that used 2007 SBO as training data.
STIP Compass: An online and interactive data repository for STI policy analysis in times of disruption
ABSTRACT. Launched in 2018, STIP Compass is an online interactive data repository that gathers data on national science, technology and innovation (STI) policies. Its overarching goal is to contribute to the monitoring and assessment of STI policies in OECD and European Union (EU) member countries and beyond. It does this through a joint OECD and European Commission (EC) digital infrastructure, which is used to survey countries on their STI policies, link the collected policy data with other information (including statistics and other databases), and provide open data services through a dedicated web portal accessible at http://stip.oecd.org.
A biennial survey on STI policies, branded as the EC-OECD Science, Technology and Innovation Policy (STIP) Survey, constitutes the portal’s original and central dataset. It is unique in its scope, nature and coverage. The survey collects qualitative information on policy initiatives, defined and characterised through several open text-fields (e.g. name, objectives, short description, start/end date, etc.) and through multiple choice fields describing policies’ direct beneficiaries, policy instruments and budget ranges, among other characteristics.
The survey’s topic coverage is structured around six “core” policy areas: (i) Governance, (ii) Public research system, (iii) Innovation in firms and innovative entrepreneurship, (iv) Science-industry knowledge transfer and co-creation, (v) Human resources for research and innovation, and (vi) Research and innovation for society. It also includes survey edition-specific “modules” that cover selected key issues of concern to the EC’s and OECD’s policy agendas and work programmes, such as STI-enabled net zero transitions.
The survey is answered by several hundred government officials, with coordination carried out by national delegates of the OECD’s Committee for Scientific and Technological Policy (CSTP). The 2023 edition of the STIP survey gathered information on more than 7,700 policy initiatives from 59 countries and the EU. The level of reporting and data quality varies by country, with some registering over 200 policies while a few others report less than 50. The average is around 100 policy initiatives per country. The policy initiatives reported vary widely in scope and scale, from ambitious national agendas to smaller R&D grant schemes. The next survey will run in spring 2025.
STIP Compass uses semantic web / linked data technologies to store, link and make accessible the information collected by the survey. These technologies provide much greater flexibility than a traditional relational database and can admit any type of data. They rely on controlled vocabularies to structure data, opening it up for linking to other types of STI data from the EC, OECD and other organisations. These include qualitative data (e.g. metadata on +10,000 EC and OECD publications and +40,000 academic articles), as well as quantitative data accessible through the STI.Scoreboard infrastructure (including +200 unique country statistical indicators, such as expenditures in R&D, doctoral graduation rates, and patent applications). This “linked data” is brought into the same database primarily to contextualise the STI policy data collected in the survey.
While both the OECD and EC make extensive use of the data in their country and thematic analyses, the expected user base is considerably broader and includes national policy makers and analysts (in governments and elsewhere, including academia). This wide user base translates into a broad range of uses of STIP Compass, ranging from consulting facts on national policies to conducting analysis of policy mixes. While accounting for data limitations, the dataset provides a wealth of evidence to map national policy mixes, compare international approaches to STI policy, enable policy learning, and tackle research questions in the field of STI policy. The STIP Compass site attracted around 200,000 unique visits in 2023 and its traffic continues to grow.
To promote data accessibility, STIP Compass has more than 700 interactive dashboards that allow users to browse the database and to zoom in and out of the data. Each dashboard has several interactive panels that show relevant policies and other types of quantitative and qualitative data, such as statistical indicators and publication metadata. As a data interface, they enable users to intuitively and visually navigate the STIP Compass database. Nevertheless, users can be overwhelmed by the wide thematic breadth of these dashboards. To overcome this limitation, STIP Compass has developed thematic portals, which are sections of the site that use tailored interfaces to bring additional layers of guidance and/or additional focus to specific policy issues, societal challenges and business sectors. Topics covered include open science, research security, Indigenous knowledge and communities, and net zero.
The analyst community can also freely download the STIP survey datasets in human- and machine-readable formats for their own analysis. The STIP Compass infrastructure achieves this through an open API, a common way for sharing open data. The download data page has a “query builder” interface that allows any user to query the STIP Compass server and download data from the database. The site also hosts a STIP Data Lab to exploit STIP Compass policy data using new analytical capabilities (e.g. natural language processing) that provide exemplars of the data’s analytical potential. The Lab aims to engage government officials and STI policy experts in co-designing and co-producing analyses, with a view to building a community of STIP Compass “lead users”.
The first part of this presentation will (i) describe and explain how this data infrastructure has been set up and the rationales informing its development; (ii) briefly present the data and features it contains; and (iii) outline how the infrastructure can be used for policy analysis and advice, particularly by the research community.
A second part will focus on recent disruptions that challenge the ways the project has so far been carried out. These include (i) emerging digital technologies, such as LLMs, which affect all phases of the project's data cycle; (ii) shifts in STI policy agendas that increasingly focus on promoting sociotechnical transformations where STI is not expected to play a leading role; and (iii) rising geopolitical tensions that can hinder the maintenance of an international harmonised policy database like STIP Compass.
*Current role: the authors are OECD-based analysts responsible for developing and maintaining STIP Compass and analysing its data.
Firms’ Knowledge Disclosure: Website, Publication, and Patent Data
ABSTRACT. This submission can be related to Thematic Panel: "AI in Science, Technology, and Innovation Policy Studies – Paradigm Shift or Necessary Compromise?"
---
The disclosures of knowledge resulting from private Research and Development (R&D) efforts have received increasing attention from innovation studies scholars and practitioners. While these disclosures can lead to unintended knowledge spillovers, hence hindering a firm from fully capturing the benefits of R&D, they can also help the firm to build its reputation, gain access to external knowledge and resources, and establish intellectual property rights (e.g., Alexy et al., 2013; Arora et al., 2018; Hicks, 1995; Rotolo et al., 2022). In this vein, research has provided evidence of the positive impact of knowledge disclosures on firms’ innovative performance (e.g., Blind et al., 2022; Jong & Slavova, 2014; Simeth & Cincera, 2015).
Research has, however, mostly focused on disclosure channels—scientific publications and patents—which are subject to well-established norms and institutional logic. While patents are granted for inventions that meet patent offices’ patentability criteria (e.g., in the case of the European Patent Office, an invention is patentable when it is “susceptible of industrial application,” “new,” and involves an “inventive step”), scientific publications are expected to undergo a process of academic scrutiny that aims to assess rigor and contribution to knowledge.
On the contrary, knowledge disclosures reported in sources that are much less subject to norms and institutional logic, such as websites, remain largely unexplored. For example, a firm can disclose knowledge on its website that is not necessarily novel, susceptible of industrial application, or provides a major step forward to the understanding of certain phenomena. These disclosures represent, however, signals that can still exert an impact on the firm’s ability to attract resources, potential partners, shareholders, investment, etc.
The importance of increasing our understanding of firms’ knowledge disclosures on their websites becomes even more evident in light of recent findings on how firm-related text data can provide valuable insights into firms’ R&D activities and strategies while also complementing traditional data sources (e.g., Bellstam et al., 2021; Gatchev et al., 2022). Although some research efforts have gone into examining firms’ website data (Axenbeck & Breithaupt, 2021; Gök et al., 2015; Nathan & Rosso, 2022; Youtie et al., 2012), there is a lack of understanding of the extent to which firms disclose knowledge through this channel and how these disclosures overlap with or diverge from other channels of disclosure.
We aim to fill this gap by addressing the following research question: Do firms disclose scientific and technological knowledge on their websites that is not disclosed through publications and patents?
Building on signaling theory (Spence, 1973), we examine firms’ behavior in disclosing knowledge on their websites as a ‘signal’ to various stakeholders and compare website disclosures with those made in scientific publications and patents. Our analysis relies on a sample of UK firms across a representative sample of sectors that we observe over the period of 2011-2022. For each firm, we longitudinally collected text data from their websites, scientific publications, and patents—longitudinal website data were collected by using WAYBACKMACHINE (https://web.archive.org/). We then relied on Natural Language Processing (NLP) and Large Language Models (LLMs) to map firms’ scientific and technological knowledge content as reported on their websites, publications, and patents.
In doing so, we built on established classification frameworks, namely the OpenAlex’s “Topic Classification” for publications and the Cooperative Patent Classification (CPC) for patents. Given that website content is typically geared towards a broader audience, LLMs are likely to capture the scientific and technical nuances of website disclosures, which may not be as explicit as those in publications and patents. This led us to a panel of 1,800 firm-year observations.
Preliminary analyses reveal that about 48% of the firm-year observations (N = 863) disclose content on websites that is not disclosed in publications and patents. We found that in about 69% of the firm-year observations within this subsample, 50% or more of the scientific and technological topics disclosed by firms on their websites were not disclosed in their publications. Similarly, in about 76% of the firm-year observations within the subsample, 50% or more of the scientific and technological topics disclosed by firms on their websites were not disclosed in their patents. These findings seem to suggest that websites represent a complementary channel of knowledge disclosure for a number of firms.
A longitudinal analysis also revealed that the above shares of firm-year observations declined from 2011 to 2020 when website topics are compared with patent topics, while it remained stable in the case of the website-publication topics comparison. We also performed a qualitative analysis of the content of a sample of firm-year observations to validate findings and provide insight on the type of disclosures. In doing so, we adopted an explanatory mixed-method research approach (Creswell & Creswell, 2023).
Our study contributes to the growing literature on text-based indicators of the innovation process by providing insights into the use of different channels of knowledge disclosure. We expect the findings to generate implications for policymakers and practitioners interested in promoting innovation and knowledge sharing among firms and across sectors.
Specialization and academic career: Different effects in different career stages
ABSTRACT. Abstract:
This paper investigates the impact of specialization on the career development of PhD students in the life sciences, with a focus on both short-term and long-term effects. It examines how specialization during the PhD period influences staying in academia immediately after graduation and the likelihood of obtaining tenure promotion later in a career. Using data from 685 PhD students in Japan, the paper finds that specialization during the PhD positively influences staying in academia but has an inverted U-shaped effect on tenure promotion. Specialization in later years, however, negatively affects tenure promotion. These findings suggest that while specialization helps PhD students establish expertise early in their careers, over-specialization may hinder long-term academic growth.
Introduction:
The paper addresses a gap in the literature by exploring how specialization influences academic careers, particularly for PhD students. Specialization is seen as a double-edged sword—it may enhance research performance by deepening knowledge but also potentially stifle creativity, which is crucial for long-term academic success. Specialization can benefit young researchers by helping them focus and gain expertise quickly, but it may later limit their capacity for creative breakthroughs as they progress in their careers. The study aims to understand how specialization affects academic careers both immediately after PhD completion (short-term) and in the longer run (long-term, including tenure promotion).
Data and Methodology:
The study uses data from 685 PhD students in life sciences at Japanese universities, all of whom graduated between 2000 and 2011. The data includes dissertations, curricula vitae, and publication records up to 2018. The main variables include the degree of specialization during the PhD period, which is measured using the Herfindahl–Hirschman Index based on the concentration of research topics in published articles. Career outcomes are assessed in two ways: staying in academia after PhD (short-run) and obtaining tenure promotion (long-run). The study also controls for factors like student attributes, professor characteristics, and the organizational context of the universities.
Results:
Short-term Effects (Staying in Academia): Specialization during the PhD period is found to positively influence the likelihood of staying in academia. The research suggests that students who specialize during their PhD are more likely to find an academic job due to the depth of expertise they develop, making them attractive candidates for entry-level academic positions. This aligns with the idea that specialization helps students build a solid knowledge base and academic profile quickly, making them competitive for early-career positions.
Long-term Effects (Tenure Promotion): The relationship between PhD specialization and tenure promotion is more complex, with an inverted U-shaped pattern. The analysis shows that moderate specialization during the PhD period increases the likelihood of obtaining tenure promotion, while extreme specialization (over-specialization) reduces the chances. This suggests that while a certain level of specialization is beneficial for establishing a solid academic foundation, excessive specialization may hinder the development of broader, more flexible skills needed for higher academic positions and independent research later in a career.
Furthermore, specialization in the years following the PhD is found to have a negative impact on tenure promotion. This suggests that as a researcher’s career progresses, specialization can limit the flexibility required for creativity and innovation, which are essential for advancing to senior academic roles.
Discussion:
The paper emphasizes that the effects of specialization are contingent on the stage of a researcher’s career. During the PhD, specialization helps students gain expertise quickly, enhancing their early career prospects. However, as their careers advance, the need for broader, more flexible knowledge becomes critical, and over-specialization can hinder progress. The findings suggest that PhD students and academic institutions need to carefully balance specialization and generalization to optimize both short-term career success and long-term career development.
The study also underscores that the mechanisms of specialization’s effects differ across career stages. During the PhD, specialization supports skill acquisition and knowledge depth, which is essential for securing an academic job. In contrast, in later years, specialization can limit creative performance and innovation, potentially reducing the chances of achieving tenure.
Conclusion:
This paper contributes to the literature on the organization of science and PhD training by providing insights into how specialization affects scientists' careers. It shows that while specialization is advantageous in the short-term (i.e., securing academic positions right after PhD), over-specialization in the long term can hinder tenure promotion due to reduced creativity and flexibility. The findings suggest that both PhD students and their supervisors should be mindful of the potential downsides of over-specialization, especially as researchers progress in their careers. Furthermore, this research has implications for the design of PhD training programs, encouraging a balance between developing deep expertise and fostering a broader, adaptable skill set for long-term career success.
Research Collaboration with Non-Academics and Academic Career Advancement: A “Scientific and Technical Human Capital” Explanation
ABSTRACT. 1. Introduction
Nowadays, academic scientists do not exist in a social vacuum or isolate themselves in the ivory tower. Over recent decades, the increasingly complex nature of modern science has encouraged academic researchers to collaborate with a wide range of individuals within and outside academia, especially in science, technology, engineering, and mathematics (STEM) fields (Bozeman et al., 2013). Recognizing this, governments and funding agencies worldwide, such as the U.S. National Science Foundation (NSF), have considered the broader societal impacts of research as an important science funding criterion since the late 1990s (NSB, 2011). Given the substantial public investment in science, there is an evolving expectation that STEM research should not only advance the scientific frontier but also bridge the gap between academia and society (Link & Wagner, 2021).
Indeed, science funding plays a crucial role in shaping today’s academic research landscape, stimulating collaborations that transcend traditional disciplinary and institutional boundaries (Arnott et al., 2020). As such, a variety of innovative research approaches have gained significant visibility in scientific practice, such as use-inspired basic research, ‘Mode 2’ science, and knowledge co-production (Howarth et al., 2022). Regardless of variations in terminologies, these approaches often involve collaboration between academics and non-academics to generate and/or translate scientific knowledge (Nguyen et al., 2020). These collaborative efforts are perceived to be effective means to align research with societal needs, thereby enhancing the use and impact of knowledge (Safford et al., 2017).
Despite the potential benefits, research collaborations with non-academics have not been widely acknowledged or institutionalized in today’s scientific enterprises (Doberneck, 2016; Hart & Silka, 2020). These efforts are often hindered by conventional disciplinary cultures and academic reward systems, which typically prioritize research excellence over the additional efforts required for external collaborations (Klein & Falk-Krzesinski, 2017). Some critics further view these collaborative practices as a departure from the traditional focus on pure scientific inquiry (Henkel, 2005). This ambivalence reflects the tension between the established academic norms and the growing expectation for academics to collaborate with non-academics. Faculty tenure and promotion, after all, usually hinges on publication-based evaluation criteria, which may not fully capture the value of research collaborations with non-academics.
Why should one care whether research collaboration with non-academics affects faculty tenure and promotion processes? One simple reason is that the benefits of such collaboration for individual scientific careers are more often assumed than empirically examined. Drawing from the scientific and technical human capital (STHC) theory, this study focuses on the impacts of these research collaborations on the career progression of individual STEM academic scientists, rather than on societal or economic benefits writ large. Using a national survey of STEM faculty in U.S. research institutions and their bibliometric data, this study employs event history analysis to address a key question:
During the course of academic scientists’ career life cycle, how does research collaboration with non-academics affect their career advancement?
Investigating this question will help disentangle the relationships between the two, shedding light on the potential benefits and challenges of such collaborations for STEM academic scientists across different career stages. Furthermore, findings will offer valuable insight for science and university policymakers, identifying practices that could improve scientific careers and, ultimately, the capacity of individual academics to produce new knowledge.
2. Data and Methods
The data for this study are drawn from two major sources: the 2012 NSF-funded national survey (NETWISE II) of U.S. academic scientists and engineers, and bibliometric data of the survey respondents. The NETWISE II survey targeted 9,925 faculty from 521 academic institutions in four STEM disciplines: biology, biochemistry, civil engineering, and mathematics. The sampling frame was stratified based on institutional type, faculty rank, and discipline, with an intentional oversampling of women. The survey was administered online and took around 40 minutes to complete, ending up with a total of 4,196 valid responses (response rate = 40.4%).
The NETWISE II study also gathered the publication histories of all survey participants. For this study, combining survey and bibliometric data creates a unique dataset that allows for in-depth analyses of publication patterns and important individual data. Given the significant variations in research priorities and faculty expectations across different types of institutions, this study specifically focuses on academic scientists employed at U.S. R1 and R2 research institutions. The final sample used in this study includes 1,237 academic scientists and engineers from 218 U.S. research institutions.
3. Findings and Conclusion
Overall, the event history analyses show that academic scientists who have ever collaborated with non-academics will achieve higher ranks to tenure and full professorship more quickly. Based on bibliometric data, these results provide evidence that knowledge-focused NA collaboration can benefit academic careers, though the effect is weaker for promotion to full professor. In other words, interestingly, the positive effects of NA collaborations on career progression are particularly pronounced for early-career academics. From the resource-based viewpoint, one possible explanation is that having these experiences provides opportunities for them to develop professional networks and build a diverse research portfolio that is beneficial to career development (Bozeman & Corley, 2004).
It should also be noted that the magnitude of NA collaborations plays a crucial role in academic career advancement. As expected, results indicate that collaborating more intensively with non-academics, rather than with academics, significantly slows down early-career scientists’ progression toward tenure. This can be attributed to the fact that collaborating with non-academics tends to be a time-consuming research practice involving uncertainties/risks that may delay publications, which is particularly an issue for early-career academics as they need to meet the traditional merit-based tenure criteria (Gulbrandsen & Thune, 2017; Pannell et al., 2019). Contrary to the initial expectation, NA collaboration intensity has no significant effect on promotion outcomes for senior academics, which is instead determined by scholarly productivity. In sum, these mixed findings demonstrate that it is important for academic scientists to maintain a balance between NA collaboration and traditional academic pursuits, especially during the early stages of their careers. If costs outweigh benefits in some cases, NA collaboration can hinder individual career progression, instead of accelerating the process.
Resistance to Innovation and Entrepreneurship in Promotion and Tenure Evaluation at Universities
ABSTRACT. Cultivating innovation and entrepreneurship (I&E) outputs from universities into society is critical in realizing the broader impacts of public and private investments in university research. Patents are an important output of this process, in which university research is commercialized into services and products that benefit society. Since the passage of the Bayh-Dole Act of 1980, which facilitates the patenting by U.S. universities of I&E derived from federally-funded research, university administrators have increased their efforts in producing patents. However, while it is clear university administration value I&E work, a pertinent question is, do the faculty members who make promotion and tenure decision equally value I&E work?
In a series of three studies, we examine how, when and why academic promotion systems disincentivize I&E, and what can be done to alleviate misalignment between I&E and what faculty value in promotion. In the first study, we examine whether faculty are rewarded for I&E activities in the promotion and tenure (P&T) process, the primary reward system in universities. Using data from 811 faculty members in STEM disciplines and 4875 ERLs submitted as part of P&T packets, we found that obtaining a patent or discussion of I&E activities in a candidate's external review letters (ERLs), was related to a larger percentage of unfavorable P&T outcomes, including a 68% reduction in the likelihood of a positive vote from the provost for candidates with patents.
In two follow up studies we examine the underlying beliefs driving these negative perceptions of I&E and how to improve them. The first was a survey of P&T decision makers which found support for a belief-based model. Most notably, we found perceptions of the value and importance of I&E was associated with the extent to which faculty believed social impact and applied research was a goal of science/scientists. In the next study, we examined intervention pathways to improve how faculty value I&E in promotion decision-making. We found that an easy-to-implement rubric intervention highlighting how I&E benefits society led faculty to value I&E more positively.
Together, these studies demonstrate the critical need to create a more inclusive academy that rewards a diversity of faculty outputs – including I&E work – for universities to succeed in generating societal and economic prosperity for the communities they serve. In our conclusion, we outline recommendations to address resistance to I&E and help realize the broader impact of science in society by aligning rewards for I&E activities with promotion systems.
Promoting capacity building in the regional innovation ecosystem: Informing the prototyping of a decision visualization tool
ABSTRACT. One of the challenges that the National Science Foundation (NSF) seeks to address through multiple funding initiatives is broadening participation in the innovation ecosystem. However, supporting and growing the innovation ecosystem requires capacity-building of “innovation nodes.” We define “innovation nodes” as any entity which both contributes to and benefits from participation in the innovation ecosystem, especially in areas related to advanced, emerging technologies, such as automated vehicles. We are particularly interested in the context of advanced automotive workforce development in Arizona.
Systematic thinking about the environmental context of innovation is lacking. A fictional scenario is often cited where appropriations in the House Science and Technology Policy Committee are made with the underlying assumption that adding more funds to a particular program will directly entail a significant innovation. The problem, however, is that, with the complexity of the evolving NIS, contexts play a major role in shaping the system. Therefore, strategic policy making will be enabled by deeper understanding of contexts, connectivity and interactions.
The major research questions that we seek to address are:
1. What are the major operation categories of innovation nodes?
2. What are the contextual characteristics of each node?
3. How do various node types respond to public policy initiatives?
In search for ways to create a shared understanding of the impact of context on innovation, we seek to build a prototype of a visualization tool that will (1) map the landscape of interrelated innovation nodes; (2) iteratively analyze and develop narratives of potential changes in the interrelations between system elements; and (3) engage different stakeholders in the co-creation and exploration of solutions. The dramatic enhancement of interactive visualization technology allows the organization of complex data to explore solutions and answering “What If” questions. Most importantly, interactive visualization technology can bring together different stakeholders, such as researchers, policymakers and the business community, to work together in transdisciplinary partnership settings. Ultimately, this project seeks to develop a prototype of a visualization tool which is crucial in organizing different stakeholders to better understand the regional innovation ecosystem.
However, a pre-work is needed to establish this tool. The research method utilizes a convergence framework in two phases. Phase 1 will seek to collect qualitative data from the local community, which will feed into the visualization tool; and Phase 2 will seek to develop the interactive visualization tool. The tool will be modifiable for other regions beyond the locality of the State of Arizona. In this conference, we report the findings from Phase 1 only.
Phase 1 involved qualitative data from key stakeholder using the conceptual framework of Lean Launchpad, originated by Osterwalder & Pigneur in 2010. This framework enables the development of a language, model and shared vision to better understand change levers within the innovation ecosystem.
Participants were recruited from organizations of different orientations: public and private, those who are at IHE and those who are leading the advanced automotive industry in Arizona. Qualitative data were collected through a structured workshop that integrated focus group discussions among various stakeholders in rotating sessions. The workshop took place with support from Arizona Commerce Authority (ACA), Science Foundation Arizona, and the Institute of Automated Mobility (IAM) in Arizona, “the first state to test and deploy self-driving cars on public roads.” Science Foundation Arizona is a non-profit organization staffed by ACA employees with mission-driven research. The Foundation is a public-private organization dedicated to diversifying and strengthening Arizona’s economy. Both the Foundation and ACA have formed a partnership to accelerate industry-education collaboration and workforce development—an important context for this study.
To collect data for Phase 1, the workshop proceeded with an embedded research goal to answer the research questions. Our effort in designing the one-day workshop was to transcend barriers to create a better understand of the system by recognizing the complex influences on changing contexts. We framed the mission at the beginning of the workshop as a response to the need to develop a coordinated curricula at Arizona universities and community colleges that support that advanced automotive industry. The industry broadly includes Connected and Automated Vehicles (CAVs) and Zero-Emission Vehicles (ZEVs).
To start the discussion, moderators identified the fast-growing population and excellent IHE as drivers for the State’s leading edge in workforce development. Arizona, for example, holds the fourth highest growth rate in education attainment and the fifth highest growth in skilled jobs, with an average of 260 people moving to Arizona every day according to a recent Census study. In 2023, Arizona’s automotive industry was first in jobs added since 2019 (135% growth) and second in average salary ($86,008). Many Original Equipment Manufacturers (OEM) have Proving Grounds in Arizona. In addition to year-round operation potential with minimal inclement weather, supporting regulations and law enforcement interactions, the State is positioned to be a leader in workforce development in the sector.
After establishing the potential of the effort, the focus groups were moderated with semi-structured interviews. There are three major themes that emerged, which are supported in the literature in other areas (e.g., the semiconductor industry). First, the need for an organization to initiate and coordinate the effort of workforce development; neither industry alone nor IHE alone can establish work at the interfaces for various reasons. Second, while content expertise is available, both proprietary issues and lab access remain a challenge in training the workforce. Third, there was a recognition of the need for upskilling: on the end of current technicians (to adapt to the new technology requirements) as well as on the faculty side (to spend sabbatical time in industry to update knowledge and pedagogies).
In summary, developing an understanding of the innovation ecosystems tends to be based on demarcation between the potential and contributions of the government, the various levels of industry partners (big and small), and the various levels of output of the IHEs. While addressing these problems is more difficult than it seems, having a visualization tool of the innovation ecosystem, and the interaction between its nodes, is one significant step toward understanding the remarkably complex system.
Entrepreneurial Ecosystems: Data-Driven Configurational Trajectories in the US
ABSTRACT. 1. Background and Motivation
Entrepreneurial Ecosystems (EE) have gained traction over the last decade as an efficient framework for understanding the significance of entrepreneurial events beyond the focus on the individual, generating relevant insights how regional factors can affect the incidence of entrepreneurship in a specific locale (Brown & Mason, 2017)). This approach is based on the argument that entrepreneurship takes place as an intrinsically systemic phenomenon (Cao & Shi, 2021). Traditional EE appraisals have mainly dealt with individual ecosystems’ elements, often neglecting the complexity upon which these structures emerge (Roundy et al., 2018). Accordingly, the substantial literature on entrepreneurial ecosystems (EE) has yet to reach consensus on defining the exact nature of entrepreneurial ecosystems and their most critical components, limiting prescriptive analyses and incorporation of its insights for regional policy.
In recent years, literature has underscored these issues, recognizing that there may be multiple configurations of self-sustaining regional entrepreneurial ecosystems, thus allowing a better comprehension of EE heterogeneous configurations and evolutionary trajectories (Cherubini Alves et al., 2021). However, as research moves forward in this respect, myriad configurations emerge in different parts of the world (Cherubini Alves et al., 2021; Fischer et al., 2024; Komlósi et al., 2024; Schrijvers et al., 2024), generating a sense of disconnection between EE conceptual landmarks and the corresponding body of empirical findings. So far, no systematic effort has been undertaken to generate robust alignment in this discussion.
Our goal in this research is to derive a typology of entrepreneurial ecosystem configurations across U.S. metropolitan and micropolitan regions and, importantly, how they change over time. By engaging in this comprehensive and longitudinal exercise we should be able to address the following research questions:
(i) What are the predominant features of EE configurations?
(ii) How do EEs change over time, and what patterns emerge from that evolution?
Ultimately, this should lead to consistent method for detecting, classifying, and assessing the trajectories of EEs across alternative configurations.
2. Method
To address the issue of entrepreneurial ecosystems configurations, we draw from widely accepted conceptualizations of entrepreneurial ecosystems (e.g. Stam & van de Ven, 2021) and combine them with “bottom-up” data analysis. Our approach seeks to understand the levels of necessity and sufficiency in ecosystems’ elements, which elements can substitute for each other, and what elements are complimentary.
Many of the most advanced ecosystems in the US are densely resourced in all nine categories, which we refer to as ‘canonically complete’ ecosystems. However, many of the other ecosystems are incomplete, but have the potential to develop or attract missing elements. Other ecosystems may have just a few elements that combine to provide unique opportunities. We will use this framework to build a dataset of relevant proxy measures of EE dimensions gathered from multiple data sources. We will use the 381 US metropolitan statistical areas (MSAs) based on economic activity to identify potential entrepreneurial ecosystems. We will then test broadly available indicators as potential outcome variables, such as the rate of start-up formation or the growth in SBIR awards to each region, to find indicators that distinguish EE configurational trajectories.
We will use fuzzy-set qualitative comparative analysis (fsQCA) to delineate the different configurations of entrepreneurial ecosystems. QCA allows the identification of configurations or ‘recipes’ of causal conditions associated with different outcomes, following the equifinality principle, i.e., multiple combinations that lead to similar outcomes. The ‘fuzzy set’ allows for the inclusion of quantitative and qualitative non-binary variables. For such metrics, calibration values or levels are defined by the researcher based on an interplay between theoretically-grounded criteria and statistical structure of data.
3. Envisaged Results
Expected findings will suggest alternative ways to nurture thriving ecosystems and support locations that are still seeking to gain traction. For instance, in the analyzed high-tech corridor, Fischer et al. (2021) found a first configuration entirely reliant on the availability of a competitive knowledge infrastructure (represented by research university campus, innovation habitats, and presence of knowledge-intensive jobs), while a second key configuration combined elements from the knowledge context (innovation habitats and Human Development Index) with characteristics of the socioeconomic system (investment attractiveness in knowledge-intensive industries). Infrastructure, human capital, credit availability and population size (approximating agglomeration economies) made up a secondary layer of important attributes. This analysis will enable decision-makers to characterize and measure the critical conditions and determine those necessary to ecosystem emergence across all configurations and those specific to certain configuration(s).
By disentangling the reasons why heterogeneous configurations co-exist and evolve among entrepreneurial ecosystems, we will be able to have a much clearer picture of what kinds of initiatives can be functional to enable entrepreneurial activity and innovation in places. Hence, this proposal comprehends state-of-the-art research that will allow taking a significant step forward in our knowledge concerning the configurational trajectories of entrepreneurial ecosystems. Based on findings from other contexts, we expect that analysis will show a broader range of ecosystem types and development paths. Plus, by applying fsQCA longitudinally in a variety of regional settings, we expect to derive a consistent set of configurations that can inform scholars and policymakers beyond the US context.
The in-demand skills portfolios of regions and their impact on productivity
ABSTRACT. Recent waves of technological change are reshuffling not only the occupational and industrial composition of countries and regions, but also the nature of skills required by labour markets, in ways that are often hard to predict (Ciarli et al., 2021). At the same time, the type and diversity of skills available to firms are a major factor in explaining productivity gaps between top and median performers (Criscuolo et al., 2021). The changing nature of in-demand skills is strictly linked to the unfolding of technological trajectories: firms adapt their skill requirements in such a way as to fully exploit the existing technological opportunities, improving their market position. It is therefore essential to harness the potential of identifying emerging skills demanded by labour markets, and to identify which are the skills combinations that are most conductive to improved economic performance.
Against this backdrop, we link the emergence of new in-demand skills portfolio to the growth of productivit y in the UK and EU regions through a three-step strategy, relying on economic complexity methods. First, we identify the emergence of new skills across UK and European regions, for each region-industry occurence. To identify skills, we exploit data on more than 200 million Lightcast Online Job Advertisements (OJA) across 11 countries (Austria, Belgium, Denmark, France, Germany, Luxemburg, Netherlands, Norway, Sweden, Switzerland, UK) between 2014 and 2020. The OJA data includes information on occupations, skills, regional location and contract type. Occupations and skills are mapped to the ESCO framework (European Skills, Competences, and Occupations). We analyze anually the skill demand trajectories within region-industry, from broadest to most granular levels (NUTS3 and 4-digit ISIC levels, respectively). Considering a timeframe of seven years allows to identify longer time-trends of emerging skill specialisations. Our data shows especially well the dynamics in service sector industries, which increasingly changed during the considered time period, due to increased digital technology development and adoption (Ciarli et al., 2021).
Second, we use different combinations of in-demand skills, such as IT-skills, to identify similar regions in terms of their changing skills demand trajectory. This is achieved by building a bipartite network connecting industries in each EU region to skills. Instead of relying on the Revealed Comparative Advantage (RCA), we follow Bruno et al. (2023) in constructing a Bipartite Weighted Configuration Model to statistically validate the network links. The resulting network infers similarity between skills (based on co-occurrence in regions) and between regions (based on shared skills specialisation). It clearly captures the variety of the European industrial landscape. For instance, we expect that Dutch regions, such as North Holland, demonstrate a strong specialization in IT and logistics-related skills, driven by their central role in trade and digital infrastructure.
From the validated network we obtain indices that quantify the internal coherence and diversity of the skills demanded by each region-industry. More precisely, we measure the connectedness of skills portfolios at the regional level, using information on the strength of the connection between skills obtained from the skills space. Moreover, drawing upon the economic complexity toolbox (Hidalgo & Hausmann, 2009; Tacchella et al., 2012) we construct a measure of skill-level sophistication. We expect that complex skills are hard to find, and that they occur in industries and occupations that require a wide set of skills.
Third, we link skills portfolios – characterised by their coherence and complexity – to the performance of industries across regions in terms of labour productivity. Data on labour productivity is available for NUTS3 regions from the Annual Regional Database of the European Commission's Directorate General for Regional and Urban Policy (ARDECO). The dataset is curated and maintained by the Commission's Joint Research Centre (JRC), based on information provided by the Eurostat's Structural Business Survey, and complemented by national and international data sources. By adding the productivity data to the skill-emergence analysis, along with controls for occupational and industrial structures as well as relevant socio-economic factors, we identify in-demand skills composition that are more associated with the productivity of EU regional industries. For instance, we expect that regions with a strong emphasis on digital and IT-related skills, such as those found in tech-driven hubs across Europe, consistently show higher productivity levels, highlighting the critical role of advanced skill portfolios in driving regional industrial performance.
In order to address potential endogeneity between the skill profile of regions and their economic performance, we exploit aggregate changes that are exogenous to individual regions and common across the sample, relying on a shift-share / leave-one-out instrument design. One such source of exogenous change is given by technological shocks, such as the uptake of ground-breaking and pervasive general-purpose technologies, like artificial intelligence (AI).
On the whole, we elaborate a differentiation and explaination of region-industry productivity through temporal dynamics of complex skill compositions. Our findings are expected to confirm the relevance of high skills (Criscuolo et al., 2021) and IT skills (Brynjolfsson et al., 2024) for labour productivity. Moreover, we expect new complex skills such as “machine learning” to appear in region-industry settings that require a high variety of related skills. With this new approach, we not only identify but also provide a new perspective on regional productivity, in the time of unprecedented, quick, and wide adoption of digital technologies.
Lunch Session Workshop: (optional) ATLC meets TFSC: A Dialogue for Science, Technology, and Innovation Policy
ABSTRACT. Technological Forecasting and Social Change (TFSC) has been a cohort of submissions in science, technology, and innovation policy for decades. Covering a broad scope of interests in technological forecasting and modelling, management of technology, impact and evaluation of technology, and emerging technology & public policy, TFSC has established its distinctive research stands on methodology and practice of technology-oriented future studies and their interplays with social, political, and environmental factors. Clearly, the ATLC community is among TFSC’s key contributors, and we value this mature, comprehensive, and sustainable relationship.
This workshop aims to support scholars, particularly the ATLC community, in developing their research ideas and manuscripts, with the goal of preparing them for submission to TFSC. In alignment with the mission of TFSC and the ATLC community’s core interests, the workshop will be organized as the following 90-minute programme.
• Welcome and Opening Remarks (15 minutes)
o Diana Hicks, School of Public Policy, Georgia Tech
A welcome address from Georgie Tech
o Mei-Chih Hu, Editor-in-Chief of TFSC
A short introduction to TFSC, and an overview of the workshop goals, structure, and agenda.
• Panel Discussion: A Conversation between ATLC and TFSC (70 minutes)
o Panellists
Diana Hicks
- Professor, School of Public Policy, Georgia Tech
Caroline Wagner
- Professor, John Glenn College of Public Affairs, the Ohio State University; TFSC Editorial Board Member
Mei-Chih Hu
- Professor, Institute of Technology Management, National Tsing Hua University; TFSC Editor-in-Chief
Yi Zhang (Moderator)
- Associate Professor, Australian Artificial Intelligence Institute, University of Technology Sydney; TFSC Executive Editor
o Session Structure
Visions of ATLC and its interplays with TFSC, Diana Hicks (10 minutes)
TFSC scope, expectations, and how to craft manuscripts aligned with TFSC, Mei-Chih Hu (10 minutes)
From the perspective of TFSC editorial board, reviewers, and readers, Caroline Wagner (10 minutes)
Discussion: How to develop theoretical contributions, frame research questions, and position work bridging the interests of ATLC and TFSC. (20 minutes)
Q&A (20 minutes)
• Closing Remarks and Next Steps (5 minutes)
o Yi Zhang, TFSC Executive Editor
Summary of the workshop, key takeaways, and plans for post-workshop follow-up
Is there a trend towards structural convergence in national university systems? Methodology and empirical test for Germany, 1995-2020.
ABSTRACT. Isomorphism (or structural similarity) is a well-known concept both in population ecology theory (Hannan and Freeman, 1977, Aldrich, 1979) and neo-institutional organization theory (Meyer and Rowan, 1977, DiMaggio and Powell, 1983). Yet, only a handful of studies have attempted to operationalize and to empirically examine it (Croucher and Woelert, 2016, Woelert and Croucher, 2018, Seeber et al., 2014, Schofer and Meyer, 2005, Scott and Biag, 2016).
Isomorphism can be understood as the opposite of diversity, and one popular claim is that when organizations form an organizational field, their structural properties tend to become more similar over time. For example, there is considerable debate whether or not universities in Europe have become structurally more similar to each other in recent decades (Hüther and Krücken, 2016, Zapp et al., 2021).
Increased structural similarity may have detrimental consequences. For example, Hollingsworth (2006) argues that national research systems characterized by a high level of isomorphism have lower capabilities to produce scientific breakthroughs, whereas countries with low isomorphism levels produce more breakthrough science and technology. While Hollingsworth’s argument regarding different capabilities for breakthrough research has been empirically validated (Heinze et al., 2020), the pervasiveness of isomorphism in higher education systems has not been established for particular countries or regions. Therefore, this paper is an attempt to characterize isomorphism in one national higher education system over 25 years and thus create a basis for future comparative analyses.
For that purpose, the paper examines isomorphism quantitatively in German higher education, using the Relative Specialization Index. Drawing on a comprehensive data set that includes professorial staff, students, as well as basic and grant funding, the paper shows, first, that most variables show an isomorphic pattern, and second that public universities have become more isomorphic over time.
The paper is organized as follows. First, the paper reviews the literature on diversity and isomorphism in higher education and science studies. Second, it introduces an exemplary density function that displays how isomorphic distributions look like. After a short introduction of the dataset and some characterization of public universities in Germany, the paper presents empirical results, followed by a short discussion. Finally, the paper discusses future avenues for quantitative research on institutional isomorphism / diversity.
References
1. ALDRICH, H. E. (1979). Organizations and Environments, Englewood Cliffs: Prentice-Hall.
2. CROUCHER, G. & WOELERT, P. (2016). Institutional isomorphism and the creation of the unified national system of higher education in Australia: an empirical analysis. Higher Education, 71, 439-453.
3. DIMAGGIO, P. J. & POWELL, W. W. (1983). The Iron Cage Revisited - Institutional Isomorphism and Collective Rationality in Organizational Fields. American Sociological Review, 48, 147-160.
4. HANNAN, M. T. & FREEMAN, J. (1977). The Population Ecology of Organizations. American Journal of Sociology, 82, 929-964.
5. HEINZE, T., HEYDEN, M. V. D. & PITHAN, D. (2020). Institutional environments and breakthroughs in science. Comparison of France, Germany, the United Kingdom, and the United States. PLoS ONE, 15, e0239805.
6. HOLLINGSWORTH, J. R. (2006). A Path-Dependent Perspective on Institutional and Organizational Factors Shaping Major Scientific Discoveries. In J. T. HAGE & M. MEEUS (Eds.) Innovation, Science, and Institutional Change. (pp. 423-442). Oxford: Oxford University Press.
7. HÜTHER, O. & KRÜCKEN, G. (2016). Nested Organizational Fields: Isomorphism and Differentiation among European Universities. The University Under Pressure. (pp. 53-83). Emerald Group Publishing Limited.
8. MEYER, J. W. & ROWAN, B. (1977). Institutionalized Organizations: Formal Structure as Myth and Ceremony. The American Journal of Sociology, 83, 340-363.
9. SCHOFER, E. & MEYER, J. W. (2005). The worldwide expansion of higher education in the twentieth century. American Sociological Review, 70, 898-920.
10. SCOTT, W. R. & BIAG, M. (2016). The changing ecology of U.S. higher education: an organization field perspective. Research in the Sociology of Organizations, 46, 25-51.
11. SEEBER, M., LEPORI, B., MONTAUTI, M., ENDERS, J., DE BOER, H., WEYER, E., BLEIKLIE, I., HOPE, K., MICHELSEN, S., MATHISEN, G. N., FRØLICH, N., SCORDATO, L., STENSAKER, B., WAAGENE, E., DRAGSIC, Z., KRETEK, P., KRÜCKEN, G., MAGALHÃES, A., RIBEIRO, F. M., SOUSA, S., VEIGA, A., SANTIAGO, R., MARINI, G. & REALE, E. (2014). European Universities as Complete Organizations? Understanding Identity, Hierarchy and Rationality in Public Organizations. Public Management Review, 17, 1444–1474.
12. WOELERT, P. & CROUCHER, G. (2018). The Multiple Dynamics of Isomorphic Change: Australian Law Schools 1987-1996. Minerva, 56, 479-503.
13. ZAPP, M., MARQUES, M. & POWELL, J. J. W. (2021). Blurring the boundaries. University actorhood and institutional change in global higher education. Comparative Education, 57, 538-559.
The impact of the Russian invasion of Ukraine on higher education and research institutions in the European borderland
ABSTRACT. Introduction
This paper presents the results of a study on the impact of the 2022 Russian full-scale invasion of Ukraine (the first invasion began in 2014) on the universities and other research institutions in 9 European countries bordering Ukraine, Russia, or Belarus.
Research Questions
1) What is the impact of the Russian invasion of Ukraine on the functioning of research and higher education institutions in countries bordering Ukraine, Belarus, or Russia?
2) Did the negative consequences of the Russian invasion of Ukraine have a more substantial impact on institutions with a relatively worse financial situation?
Methods & data
A survey of scholars working in higher education and research institutions in Estonia, Finland, Hungary, Latvia, Lithuania, Moldova, Poland, Romania, and Slovakia. The survey questions were developed based on 11 individual interviews with scholars from the abovementioned countries.
Respondents were invited from a random sample of corresponding authors of publications indexed on the Web of Science database. The survey was conducted online (February- March 2024). It was available in English and 8 other languages used in the 9 countries covered by the study (Estonian, Finnish, Hungarian, Lithuanian, Latvian, Polish, Romanian, Slovak). We collected 3,743 fully completed surveys (response rate of 10%), with adequate representation of all surveyed countries (Estonia 334, Finland 407, Hungary 413, Latvia 486, Lithuania 527, Moldova 123, Poland 548, Romania 465, Slovakia 440). The data were analysed using descriptive statistics and logistic regression.
Results and conclusions
The study uncovered a complex and multifaceted impact of the Russian invasion of Ukraine on higher education and research institutions across nine European countries bordering Ukraine, Russia, or Belarus. A significant proportion of respondents (22.5%) reported that their research activities were negatively or strongly negatively affected by the invasion. Key challenges included the suspension of scientific projects (9%), restricted access to research infrastructure (8.9%), and difficulties conducting field research (10.4%). Many scholars also experienced shifts in their academic focus, with 13.3% revising their research plans and 12.8% redirecting their research interests. Additionally, teaching activities were disrupted, as 10.6% of respondents indicated changes in their curricula due to the geopolitical turmoil.
The institutional response to the invasion was marked by significant strategic adjustments. Over 21% of respondents noted that their institutions had modified their development strategies in response to the crisis. Moreover, the invasion led to both opportunities and challenges in collaboration. While 17.4% of scholars reported new international collaboration opportunities, the invasion also disrupted existing partnerships, particularly with Russian institutions. The influx of Ukrainian students offered an unexpected benefit for many universities, partially mitigating the broader decline in student enrollment faced by the region. However, the cancellation of scientific events (18.2%) further underscored the invasion's pervasive impact on academic life.
The findings from logistic regression analysis reveal stark disparities in how institutions were affected. Financially weaker institutions faced more pronounced disruptions, reflecting and exacerbating pre-existing inequalities in the academic sector. Regression analysis indicated that institutions with stronger financial and reputational standing were better positioned to navigate the challenges posed by the crisis. Additionally, scholars deeply engaged in international collaboration—particularly with Ukrainian or Russian partners—were both more exposed to the invasion's adverse effects and more likely to capitalize on emerging opportunities for global engagement.
These results highlight broader systemic issues in the region’s higher education and research sector. Chronic underfunding, brain drain, and declining student admissions—already pressing challenges in many of the surveyed countries—were further intensified by the invasion. The unequal impact across institutions risks deepening these disparities, particularly for those in financially precarious situations. Yet, the crisis also spurred adaptive strategies, fostering new research collaborations and creating opportunities for institutional renewal.
The study underscores the need for targeted interventions to support vulnerable institutions and scholars. Strengthening international partnerships, increasing financial investment in underfunded universities, and promoting cross-border academic cooperation are essential to mitigate the invasion’s long-term repercussions. These measures not only address immediate challenges but also lay the groundwork for a more resilient and equitable higher education and research system in the European borderland. The findings offer insights for policymakers and academic leaders as they navigate the complex interplay of adversity and opportunity in a volatile geopolitical context.
Understanding the Motivations and Barriers to Academic Scientists’ Engagement in Co-Production of Knowledge
ABSTRACT. 1. Introduction
The imperative to integrate academic research with societal needs has never been more pronounced than in the contemporary scientific landscape. Traditionally, the scientific paradigm has long prioritized pure inquiry or basic research (Stokes, 1997). In recent decades, given the evolving societal demands and expectations of publicly funded science, the U.S. National Science Foundation has paid special attention to the broader societal impact of research (NSF, 2022). Particularly pertinent to this funding shift is the notion of knowledge co-production, a practice that involves both academic and non-academic knowledge sources to better align scientific research with real-world applications (Adelle et al., 2020; Gerber et al., 2023).
Co-production of knowledge, defined as a collaborative, iterative approach integrating diverse perspectives of academics and non-academics throughout the research process, has become a cornerstone for sustainable and responsible research innovation (Dave et al., 2018). The inclusion of various actors in this process not only enhances the potential to produce actionable science but also fosters the development of solutions that are more applicable to addressing complex social problems (Mills et al., 2023; Norström et al., 2020). Engaging academic scientists in co-production therefore represents a pivotal shift towards addressing the multifaceted social problems to enhance the societal impacts of scientific research (Beckett et al., 2018; Zurba et al., 2022).
Despite its recognized value, knowledge co-production has not yet become a mainstream norm in the landscape of higher education institutions (Hart & Silka, 2020). The academic reward system, which typically prioritizes research excellence, often overlooks academic scientists’ outreach activities that directly collaborate with non-academics (Azman et al., 2019). As such, the engagement of academic scientists in knowledge co-production is not a common practice but is often rather driven by large science funding initiatives.
Yet, little is known about the specific factors influencing individual scientists’ perceptions of undertaking such non-traditional collaborative research endeavors. These factors can range from institutional support and cultures to individual motivations, values, skills, and/or the availability of resources. For instance, a study by Karlsdottir et al. (2023) highlights that individual factors such as age and academic discipline significantly influence perceptions of barriers to collaboration with industry partners, particularly those related to teaching obligations and university resources. This suggests that early career researchers and/or academics from certain disciplines might perceive greater obstacles to engaging in non-traditional collaborative activities such as co-production. Additionally, organizational culture and the broader institutional environment can also play a critical role in shaping individual perceptions and behaviors (Crow et al., 2020; Lattu & Cai, 2023). Understanding these factors is crucial as they can affect academic scientists’ propensity to engage in knowledge co-production, and our research seeks to fill this research gap. Therefore, drawing from the theory of planned behavior (Ajzen, 1991), our study will examine these research questions:
1) How do academic scientists perceive knowledge co-production and why?
2) How do academic scientists’ perceptions affect their intention to engage in knowledge co-production?
2. Data and Methods
To address the research questions, we will use data from a national survey (NETWISE III study) of over 30,000 tenured and tenure-track faculty from 9 STEM disciplines across U.S. Carnegie Classified R1 universities. The survey was launched in October 2024 and expected to be closed in January 2025. In this survey, respondents were asked about their perceptions and prior experiences regarding knowledge co-production with non-academics.
The dependent variables of our study are twofold: (1) the perception of research collaboration with non-academics, and (2) the intention to engage in knowledge co-production. As informed by the theory of planned behavior, the key constructs are operationalized through a series of survey questions that assess academic scientists’ attitudes toward research collaboration with non-academics, their perceived behavioral control/capabilities, subjective norms (e.g., research motivations and collaboration preferences), and intentions of engaging in knowledge co-production. Other variables include individual factors (e.g., gender, race/ethnicity, academic rank, and discipline), as well as organizational factors, such as departmental support, organizational culture, and the availability of resources for conducting collaborative research with non-academics.
Given that the proposed model includes both observed and latent variables, we will use the partial structural equation model (SEM) for data analysis. The SEM will provide robust estimations that allow us to test complex relationships among these variables simultaneously while accounting for the measurement error (Musil et al., 1998).
3. Preliminary Findings and Conclusion
Our preliminary analysis, based on over 900 survey responses collected so far, reveals that 60% of respondents have collaborated with a diverse range of non-academic partners for research purposes, including governments, nonprofits, community organizations, citizen science groups, etc. When asked about the proportion of their current research portfolio involving co-production, respondents reported an average of 38%. Moreover, these collaboration experiences span different phases of knowledge co-production. Notably, the most common activities include communicating research results to non-academics (44%) and co-authoring academic publications with non-academics (24%). Other collaborative efforts involve translating research findings into real-world applications (10%), and technology design and development (8%). Relatively smaller proportions of respondents reported collaborating with non-academics on other research tasks such as interpreting research results, data analysis, data access and collection, research design, and identifying research problems or questions.
Overall, our study findings will help identify the individual and organizational factors related to academic scientists’ propensity to engage in knowledge co-production. In particular, our research centers on individual scientists’ perceptions and experiences, offering a unique perspective by considering factors such as motivation and human capital. By shedding light on the motivation and barriers to academic scientists’ engagement in knowledge co-production, this study will contribute to the existing literature on this timely topic. Ultimately, this study will offer valuable insights for science policymakers and university administrators by informing them about research and university policies that can help facilitate knowledge co-production.
Public Acceptance on Air Taxis: Using the UTAUT2 framework to identify acceptance on unmanned aerial mobility for users and non-users
ABSTRACT. Due to the highly advanced aerial transportation technology, commercial operations recently began to turn up in several areas including New York, Mexico City, and Dubai. As unmanned aerial mobility (UAM) offers fast and quiet travel, it is expected to expand in use in both urban and rural areas. However, whether the public is favorable to this technology remains questionable. As the consideration of the public acceptance of emerging technologies before their diffusion is necessary, this study attempts to conduct a multivariate analysis on UAM acceptance in South Korea. South Korea is selected as a case study due to the recent attempts of the Korean government to introduce UAM for cities that suffer from high traffic (Future Drone Traffic Manager, 2020; UAM Team Korea, 2021).
Preliminary research that focused on the public acceptance of the technology used the Technology Acceptance Model (TAM) measuring user’s perceived usefulness and perceived ease of use, and adding the trust variable as people are unconfident in emerging technologies (Chancey, 2020; Johnson et al., 2022; Kim et al., 2023). In addition, they usually focused on unmanned and automated vehicles that were devised to scale up operations sacrificing safety (Chancey, 2020; Johnson et al., 2022). However, citizens remain reluctant to ride a vehicle without a pilot, and the Korean government is planning to require a pilot to board the UAM for its operation (UAM Team Korea, 2021). Therefore, studies that focused on unmanned UAMs provide insufficient information for immediate policy implications. Moreover, preliminary studies tend to focus only on the perspective of potential users, which excludes the non-users out of the scope who might feel discomfort with the commercialization of UAM. Therefore, this study focuses on the acceptance of piloted UAM considering both users and non-users. This study uses the Extended Unified Theory of Acceptance and Use of Technology (UTAUT2) model, which is an extended model of UTAUT that combines eight technology acceptance models including Theory of Reasoned Action (TRA), TAM, and Theory of Planned Behavior (TPB) (Venkatesh et al., 2012; Alomary & Woollard, 2015).
To study the public acceptance of UAM, an online survey with 1800 South Korean respondents was conducted. The respondents were grouped into two depending on their intention to use UAM, namely, the users and non-users. They were asked about their sociodemographic information that is related to the acceptance of technology such as age (Arning & Ziefle, 2007), and gender (Gefen & Straub, 1997; Venkatesh & Morris, 2000) in addition to behavioral intention (BI), performance expectancy (PE), effort expectancy (EE), social influences (SI), facilitating conditions (FC), hedonic motivation (HM), price value (PV), and habit (Venkatesh et al., 2012). Additionally, they were asked whether they would feel safe when using UAM (SWU) and when they were near (SWN). The survey respondents were given a short introduction to read about air taxis and their performance before answering the questions.
Structural equation modeling is used to analyze social acceptance towards UAM in South Korea. The results indicate that performance expectancy, social influence, hedonic motivation, price value, and safety when near are key predictors of behavioral intention to use UAM. Notably, these variables were significant in evaluating the intention of potential users. However, only hedonic motivation and price value remained as important predictors in the non-user group.
This study contributes to the literature on social acceptance towards UAM by introducing an additional dimension, dividing the respondents into two groups. Current studies tend to focus solely on future users, which provides limited scope and understanding, as the use of UAM may affect non-users’ quality of life, residing location, safety, and privacy. Understanding the key determinants of the acceptance of both groups serves as a foundational step for the discussion between the public and the UAM industry. Furthermore, this study may provide a reference for technology developments to enhance public acceptance on UAM, addressing key determinants of users and non-users.
Reference
Alomary, A., & Woollard, J. (2015). HOW IS TECHNOLOGY ACCEPTED BY USERS? A REVIEW OF TECHNOLOGY ACCEPTANCE MODELS AND THEORIES.
Arning, K., & Ziefle, M. (2007). Understanding age differences in PDA acceptance and performance. Computers in Human Behavior, 23(6), 2904–2927. https://doi.org/10.1016/j.chb.2006.06.005
Chancey, E. T. (2020). Effects of Concepts of Operation Factors on Public Acceptance and Intention to Use Urban Air Mobility (UAM) – Trust and Technology Acceptance Modeling. Air Mobility.
Future Drone Traffic Manager. (2020). 도시의 하늘을 여는 한국형 도심항공교통(K-UAM) 로드맵 [Urban Air Mobility(K-UAM) Roadmap opening the city sky]. https://www.molit.go.kr/USR/NEWS/m_71/dtl.jsp?id=95083976
Gefen, D., & Straub, D. (1997). Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model. MIS Quarterly, 21, 389–400. https://doi.org/10.2307/249720
Johnson, R. A., Miller, E. E., & Conrad, S. (2022). Technology Adoption and Acceptance of Urban Air Mobility Systems: Identifying Public Perceptions and Integration Factors. The International Journal of Aerospace Psychology, 32(4), 240–253. https://doi.org/10.1080/24721840.2022.2100394
Kim, Y. W., Lim, C., & Ji, Y. G. (2023). Exploring the User Acceptance of Urban Air Mobility: Extending the Technology Acceptance Model with Trust and Service Quality Factors. International Journal of Human–Computer Interaction, 39(14), 2893–2904. https://doi.org/10.1080/10447318.2022.2087662
UAM Team Korea. (2021, September 28). 한국형 도심항공교통(K-UAM) 운용개념서 1.0 [Korean Urban Air Mobility (K-UAM) Management Concept Description 1.0]. https://www.molit.go.kr/USR/NEWS/m_71/dtl.jsp?lcmspage=1&id=95086041
Venkatesh, V., & Morris, M. G. (2000). Why Don’t Men Ever Stop to Ask for Directions? Gender, Social Influence, and Their Role in Technology Acceptance and Usage Behavior. MIS Quarterly, 24(1), 115–139. https://doi.org/10.2307/3250981
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012). Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology (SSRN Scholarly Paper 2002388). Social Science Research Network. https://papers.ssrn.com/abstract=2002388
Implementing equity in an advanced manufacturing project: Lessons for operationalizing responsible AI
ABSTRACT. With recent AI advancements, public awareness of AI-related harms—like bias, discrimination, and privacy violations—has increased, prompting efforts to align AI systems with public values. Various bodies have developed frameworks that require AI systems to conform with values such as transparency, explainability, and fairness; while major AI developers (‘Big Tech’) have introduced their own responsible AI principles. However, these values and principles are often critiqued as vague and too high-level (Schiff, 2023) raising questions about how they should be operationalized.
This challenge is not new in the field of responsible research and innovation (RRI). For instance, Tabares et al. (2022) documented the diffused implementation of RRI across eight programs of the European Commission’s Horizon Framework Programme for Research and Innovation (H2020), highlighting challenges in moving from theory to practice. Christensen et al. (2020) also explored how the perceptions and operationalizations of RRI varied among five different organization types, namely public funding agencies, private research foundations, universities, private companies, and civil society organizations, across different countries. Such studies reveal that values and principles as those promoted by Big Tech and other authoritative bodies do not smoothly translate from into practice, undergoing significant modification by different stakeholders. However, systematic understanding of how these changes occur is still limited.
To contribute to this understanding, we examine the case of the Georgia Artificial Intelligence in Manufacturing (Georgia AIM) Project, a $65 million federally funded initiative to integrate AI into Georgia’s manufacturing economy. Our study focuses on equity as a project value, asking:
1. How is equity being operationalized in the Georgia AIM project?
2. What factors influence equity’s operationalization in this project?
To answer, we collected data from both primary and secondary sources. For the primary sources, we facilitated a workshop on equity for manufacturing extension agents involved in the project (see workshop report: https://doi.org/10.31235/osf.io/ujfsq) and conducted 24 semi-structured interviews with project leaders. For the secondary sources, we reviewed project documents including the Economic Development Administration [EDA]’s call for proposals [CFP], and the grant proposals, namely the overarching project narrative for Georgia AIM and the project narrative for each of the 8 subprojects under Georgia AIM. We employed thematic analysis to analyze the data using NVivo qualitative data analysis software.
Focusing on 3 aspects of equity, namely the what, whom, and how of equity, the thematic analysis uncovered patterns that answer our first research question. We discovered that the object (what) of equity expands during operationalization. Equity moves from being a narrow economic conceptualization influenced by the sponsor (EDA)’s definition, to including socio-economic considerations in response to environment-specific needs of the projects and other broader aims. In contrast, the subject (whom) of equity narrows as it moves from conceptualization to operationalization, with the identification of beneficiaries becoming more specific during implementation. Lastly, we found that the how of equity becomes more varied and intensified during operationalization along the four pathways of processes, programs, places, and projects. To answer the second research question, the thematic analysis further identified 8 factors as the determinants of how equity is being operationalized in the Georgia AIM project. These are logistical, contextual, political, institutional, metrological, technological, resource-based, and personal factors. The aggregate impact of all the factors combined leads to the variations observed in the implementation of equity and determines how equity is operationalized. This, however, is not an identification of a strict causal relationship between each factor and the variation observed in the operationalization of equity. Rather, it is a systematic categorization of the influences on the operationalization of equity, to serve as a heuristic for discovering specific causes of variations in implementing equity. The factors discovered in this study are not comprehensive or exhaustive and could be expanded by further research.
Our findings have two main implications. First, we provide empirical evidence on how equity, as a pillar of public administration, evolves in large-scale public innovation and economic development projects. We show how equity changes from conceptualization through implementation and offer a pragmatic heuristic to aid project leaders in successfully implementing equity. While this is a single case study with limited generalizability, our study provides an initial understanding of how equity changes helpful for project leaders to anticipate the identified patterns of change and devise plans for addressing important equity determinants that may be crucial for project success.
Second, our study advances the RRI literature. While many RRI projects aim to incorporate equity, few studies have examined its real-world dynamics. In providing evidence that principles like equity are seldom static during implementation even within the same project, our study provides useful insights that are especially relevant to one of the areas of responsible innovation that has received much attention lately, responsible AI. With the proliferation of AI principles and ethical frameworks by organizations and different stakeholders, this study provides evidence that these principles will not translate directly as they have been conceptualized but will instead be subject to many variations and evolutions during their operationalization. By understanding how principles like equity translate and the factors that should be considered during their implementation, organizations and other stakeholders may be able to better realize the goals of responsible AI.
References
Christensen, M. V., Nieminen, M., Altenhofer, M., Tangcoigne, E., Mejlgaard, N., Griessler, E., & Filacek, A. (2020). What’s in a name? Perceptions and promotion of responsible research and innovation practices across Europe. Science and Public Policy, 47(3), 360-370. https://doi.org/10.1093/scipol/scaa040
Schiff, D.S. (2023). Looking through a policy window with tinted glasses: Setting the agenda for U.S. AI policy. Review of Policy Research, 40(5), 729-756. https://doi.org/10.1111/ropr.12535
Tabarés, R., Loeber, A., Nieminen, M., Bernstein, M. J., Griessler, E., Blok, V., Cohen, J., Honigmayer, H., Wunderle, U., & Frankus, E. (2022). Challenges in the implementation of responsible research and innovation across Horizon 2020. Journal of Responsible Innovation, 9(3), 291–314. https://doi.org/10.1080/23299460.2022.2101211
Understanding Future AI-Green Technology Directions from Past Technological Trajectories
ABSTRACT. Short Abstract
We combine scientometrics and generative AI (ChatGPT) to analyze the intersection of AI and green technologies. Leveraging technological trajectories built using the entire EPO data, the study identifies current common themes and projects future directions of twin (AI and green) technologies. Generative AI summarizes patent information, revealing technological paradigms and their expected future evolution. Initial findings highlight key areas like automation, environmental management, and IoT integration. In ongoing work we are expanding the analysis, enhancing replicability, and comparing results with other NLP methods for a more robust representation of past and future technological developments.
Extended abstract
The intersection of artificial intelligence (AI) and green technologies represents a crucial frontier in addressing the climate emergency. This paper studies the dynamic landscape of AI-related green innovations, aiming to map current trends and project future trajectories of technological development. Our methodology combines established scientometric analysis with the emerging capabilities of generative AI, leveraging a comprehensive database of technological trajectories constructed from the all inventions in the European Patent Office (EPO) data.
We focus on the convergence of AI and green technologies within our trajectory database that covers all inventions in the EPO. Technological trajectories, represented as chains of patents linked by citation relationships, offer valuable insights into the evolutionary pathways of these inventions. We employ generative AI, specifically ChatGPT, to synthesize information extracted from patent titles and abstracts, generating concise summaries for each technological trajectory.
This AI-driven summarization approach allows us to efficiently analyze a substantial number of trajectories. Our initial dataset comprises approximately 43,000 trajectories identified as relating to both green technologies (classified using Y02 and Y04S CPC codes) (Nomaler and Verspagen, 2019) and digital technologies (as identified in our earlier work (Menendez De Medina et al, 2023; Prytkova et al 2024)). We then refined this set, focusing on 950 trajectories that explicitly mention "artificial intelligence" or "machine learning" within their titles or abstracts. From this refined set, a random sample of 32 non-overlapping trajectories was selected for in-depth analysis, ensuring that no single patent was represented in more than one trajectory.
For each trajectory within this sample, we provided a structured prompt to ChatGPT, requesting: (1) a descriptive summary of the trajectory’s technological development, (2) a reasoned prediction of potential future directions for the technology, and (3) identification of closely related technologies that could contribute to these future advancements. We provided to ChatGPT a data record containing title, abstract, priority year, and the position in the trajectory. ChatGPT's responses were formatted to clearly distinguish between these three requested components.
Building upon these individual trajectory summaries, we further utilized ChatGPT to identify common technological "paradigms" emerging across the set of trajectories. These paradigms represent overarching themes or fundamental technological building blocks that characterize groups of related trajectories. We conducted separate analyses for past and future paradigms, providing ChatGPT with the descriptive summaries of the trajectories (1) for the former and the predicted future directions (2) for the latter. This process resulted in the identification of eight distinct past paradigms, including categories such as "Automation and Control Systems," "Environmental Management and Sustainability," and "Energy Productino and Management." For future paradigms, ChatGPT identified six key paradigms, such as "Integration with IoT and Smart Systems," "Enhanced AI and Machine Learning Integration," and "Sustainability and Energy Efficiency."
To visualize the relationships between these paradigms and the underlying trajectories, we constructed a tripartite network. In this network, the 32 trajectories serve as the connecting links between the past and future paradigms, as each paradigm is characterized by the set of trajectories it encompasses. We employed VOSviewer (Van Eck and Waltman, 2010) to map this tripartite network, providing a graphical representation of the patent landscape for green technology and AI derived from our ChatGPT-assisted analysis. The resulting network map revealed a central cluster of broadly applicable future paradigms, surrounded by more specialized clusters of trajectories and past paradigms. These specialized clusters corresponded to areas like mobility (with a focus on emission control), wind turbine technology, industrial automation, and environmental monitoring, offering a structured overview of the key areas of innovation within the AI-green technology domain.
This pilot study provides evidence for the potential of combining traditional scientometric methods with the capabilities of generative AI to gain insights into complex technological landscapes that may be difficult to describe with standard labelling methods and topic modelling.
The current study is based on a relatively small sample of trajectories. Moreover, the reliance on ChatGPT introduces inherent challenges to replicability. We are currenlty addressing these limitations by scaling up the analysis to encompass a significantly larger number of trajectories, ultimately aiming to cover the entire dataset of 43,000 trajectories related to green and digital technologies. Furthermore, we are implementing this work using generative AI systems that can be replicable, such as Llama, offering greater control over parameters. Finally, we will compare and contrast our generative AI-driven findings with results obtained through more established NLP techniques, such as sentence embeddings and semantic similarity analysis, to validate the insights generated by AI and ensure the reliability of our conclusions.
ABSTRACT. Emerging digital automation technologies such as AI can have several impacts on the future of work, depending on the extent to which they can replace, complement, or create new tasks. For example, the automation and computerization waves of the 1990s and early 2000s have been impacting occupations with high content of routine tasks, especially manual (Goos and Manning, 2007; Acemoglu and Autor, 2011; Goos et al., 2020). AI and related technologies, though, are being developed to perform tasks that were commonly referred to non-routine (Frey and Osborne, 2017; Nedelkoska and Quintini, 2018) and abstract tasks (vom Lehn, 2020), which use human observation and judgement that is not standardised (Savona et al., 2022).
In this paper, we combine views from a thousand experts from science, technology, business, civil society, and policy to make predictions about which tasks different emerging digital automation technologies will perform by 2030.
To do so, we first implemented an articulated real-time Delphi survey. The survey asked experts from academia, industry and civil society to identify the three technologies most likely to be used by 2030 from around 600 emerging automation technologies, grouped into eight families — AI & Intelligent Information Systems, Robotics, Computing, Networking, Data Acquisition, Data Management, User Interface and Additive Manufacturing Technologies — and several subfamilies (see Olivera et al, 2004).
Next, we asked what tasks these technologies will be able to perform by 2030. We first asked to select among all the O*NET Broad Work Activities — such as Getting Information, Making Decisions and Solving Problems or Handling and Moving Objects. We then use O*NET Detailed Work Activities to obtain more fine-grained knowledge about the technology’s capability to perform specific tasks. Once they had connected technologies with detailed work activities, survey participants were asked to assess to which extent technology-work activity pairs complement or substitute one another and to which extent the technology codifies or enhances the efficiency of such respective work activity.
Preliminary results show that the most relevant emerging automation technologies (largely driven by AI) will mostly perform Information and Data Processing activities, and activities related to Reasoning and Decision Making. At the other end, the Broad Work Activities least selected relate to Communicating and Interacting, and Coordinating, Developing, Managing and Advising.
Automation technologies, though, vary in the kind of work activities they can perform based on their technical features, applications, and industries of adoption. To assess the exposure of work activities to each technology family, we compute the ratio between the relative frequency of each BWA by technology family and the average frequency for all technology families. The results confirm the general purpose of AI emerging technologies. With the exception of manual activities such as handling and moving objects, and performing general physical activities, AI technologies can perform most other activities. The only other activities in which AI is less relevant to human are those related to monitoring processes and resources, and operating vehicles: these are tasks performed mainly by IoT and related networking technologies.
To understand whether the top emergent technologies will more likely replace, complement, codify tasks or make them more efficient, we asked survey participants to assess each of the following statements on a 5 points Likert scale:
1. By 2030, this technology will replace humans in carrying out the following task;
2. By 2030, the following task will be sufficiently standardized (or routinized) that they can be carried out automatically by this technology;
3. By 2030, the knowledge/information to undertake the following task will be sufficiently codified and written in protocols for this technology to carry it out;
4. By 2030, this technology will make this task more efficient.
For all eight technology families, participants strongly agree with the high potential that emerging technologies have in increasing the efficiency of performing the task. Responses differ substantially when assessing if the technology will complement or substitute humans. On the one hand, most experts agree on the complementarity between digital automation technologies and humans in carrying out a given work activity across all families. On the other hand, experts’ opinions diverge when assessing machine-human substitution. The level of consensus varies across technology families. Experts in Robotics and AI think that these technologies are more likely to substitute humans in the corresponding tasks than, for instance, Computing, Additive Manufacturing, and User Interface technologies. In Robotics, this is mainly the case for Manipulative robots, Software/virtual robots, and Smart Materials. In the case of AI, it is Robotics applications and Computer Vision, where the largest share of experts consider that the technology may substitute humans.
Building on our unique survey results, we revise and complement existing measures of occupational exposure (Arntz et al., 2017; Nedelkoska and Quintini, 2018). Our exposure measure considers the task content of each occupation, the relevance of each task to a given occupation, and the individual exposure of each task to automation. Moreover, our measure is forward-looking: it is based on exposure to technologies that are more likely to be of high relevance in the near future, increasing the measure’s reliability. Finally, by considering different forms of technology-labor interaction (i.e., whether a given technology is complementary or substitutable to a given task), we address nuances that bring valuable information for decision-making: workers in occupations composed of many tasks highly exposed to automation substitution can be more affected than workers in occupations where tasks are highly complementary to technologies.
Our finding suggest that we may expect a different reshuffle of jobs with respect to the polarisation of labour observed with ICT. The most exposed to emerging technologies are clerical support workers, technicians and professionals (as also shown by complementary work in Prytkova et al. (2024)). These include routinized mid skilled occupations such as secretaries, but also highly educated ICT technicians and higher education teachers. Low skilled elementary and craft and related trade workers are the least exposed. However, differently from previous work, we distinguish between substituting and complementing tasks, and show that high skilled professionals will be using AI and information technologies to complement their work.
Employment and Reenrollment Behavior Among Students in Stackable Credential Pathways in Technical Fields: Evidence from Ohio
ABSTRACT. Background and Rationale
Policymakers in many U.S. states are making significant investments in the closely related goals of (1) increasing the rates at which individuals from low-income backgrounds are able to achieve a stable income and a family sustaining wage, (2) growing college enrollment and graduation among adult-age individuals, and (3) strengthening state economic resilience and vitality by increasing growing the share of the workforce who hold educational credentials with value to the labor market. In support of these goals, federal policymakers are making substantial investments in improving access to and completion of career and technical education (CTE) programs, particularly at the subbaccalaureate level, that are aligned with current and emerging STEM workforce needs. Unfortunately, efficient resource utilization to maximize the achievement of these goals is hampered by sizeable gaps in our understanding of the landscape of subbaccalaureate education, pathways through postsecondary education, students’ use of those pathways, and the relationships between subbaccalaureate education and workforce opportunities. One blind spot that is especially impactful due to its size and the potential for disparate outcomes for historically marginalized students is the role of for-credit stackable credential pathways.
The U.S. Department of Labor defines these stackable credential programs as “a sequence of credentials that can be accumulated over time to build up an individual’s qualifications and help them to move along a career pathway or career ladder to different and potentially higher-paying jobs.”(US DOL, 2020, p. I-3). Stackable credential programs are typically designed to operate as follows: A student enters community college and first earns a postsecondary certificate, which requires under two years of full-time equivalent coursework. The certificate-earner then exits the community college and works full-time in a position related to their certificate. Some time later, the certificate-earner reenrolls in college, pursuing another closely related credential that builds upon credits they have already earned and knowledge they have already mastered. Yet, emerging research demonstrates that community college students may stack credentials in myriad ways beyond policymakers’ and administrators’ original designs (Daugherty et al., 2022).
It remains unclear how students are leveraging stackable credentials to improve labor market opportunities in STEM. Said another way, we do not fully understand where credential stacking fits in students’ labor market trajectories. For instance, we do not know to what extent students are compelled to re-enroll in college and earn a second credential in a stackable sequence by an economic shock, by low earnings following their first credential, by opportunities for advancement with substantial earnings gains, or by other precipitating factors. Therefore, we ask, among individuals who have completed an initial CTE certificate, how are patterns of labor force participation and re-enrollment related to earning a stacked credential?
Methods and Data
We use administrative datasets from the Ohio Longitudinal Data Archive (OLDA), matched with earnings records from the state’s Unemployment Insurance (UI) systems. OLDA data includes all public postsecondary institutions in Ohio, including records of students’ credentials, enrollments, transcripts, and demographics.
We constructed a sample of all students who earned a short or long-term certificate in a CTE academic field from an Ohio community college between 1 July 2006 and 31 December 2013. Restricting the sample to individuals who earned their first certificate between 2006 and 2013 ensured that we could observe a full six-year time window of subsequent employment and educational behavior prior to the onset of the COVID-19 Pandemic in 2020 Q1. Our sample includes all individuals aged 20 to 60 at the time at which they earned their initial certificate. The sample was further restricted to exclude those who were ever dual-enrolled in high school and an Ohio Community College, who earned multiple “stacked” credentials simultaneously with their initial certificate, and those students without a valid workforce ID. These sample restrictions resulted in a finalsample of 23,527 unique students.
Results
We find that, among initial certificate-earners who remained enrolled in college in the subsequent economic quarter, over half (57%) went on to successfully stack credentials within six years. In contrast, among those who did not enroll in college during the subsequent economic quarter, only 9% went on to stack credentials within six years. Among those who exited college before stacking at any point in the first year after earning their initial certificate, only 11% went on to stack credentials. In fact, over two-thirds (68%) of stackers were enrolled in college continuously between the times they earned their first and second credentials. This means that stacking-eligible individuals who fully exit college for any length of time rarely return to complete a second certificate. We also find that student behavior within stackable credential pathways is highly influenced by the field of study of a student’s initial certificate. We do not find that poor local economic conditions encourage credential stacking.
Significance
These results raise important questions about the validity of programmatic models for stackable credentials that propose periods of temporary non-enrollment in higher education. Such exits may discourage degree completion and hamper student performance in stackable credential pathways. This research helps us improve our understanding of students’ actual behavior in stackable credential programs and suggests opportunities to improve our theoretical understanding and evaluation of such programs. It also helps us better understand the role and potential of stackable credentials as a tool for workforce development and retraining.
Acknowledgements
The research was supported by a Lumina Foundation grant to the University of Michigan. We thank our partners at the Ohio Department of Higher Education and the Ohio Education Research Center.
Does training in AI affect PhD students’ careers? Evidence from France
ABSTRACT. Artificial Intelligence (AI) technologies profoundly transform our social and economic systems, spreading to most fields (Agrawal et al., 2019). The growing importance of AI has made the knowledge related to those technologies a highly valuable asset for individuals when competing in the labor market. Extant studies have focused their attention mainly on the demand side of the labor market and documented the companies’ increasing demand for workers with AI training (Squicciarini and Nachtigall, 2021; Acemoglu et al., 2022; Acemoglu and Restrepo, 2019). Little is known about the supply side, i.e., those individuals with AI knowledge facing the labor market.
We aim to fill this gap by assessing the impact of pursuing AI training on individuals’ career paths. As suggested by Lane and colleagues (2024), “any attempt to describe the economy-wide impact of public investment in AI would involve identifying the people at the heart of these investments’’ (page 303). In the last decade, governments, seeing educated workers as the engine of economic growth, have invested increasing funds in their higher education systems. A substantial part of those funds has been directed to train PhD students (Cyranoski et al., 2011), individuals trained at the frontier of science and technology.
In this paper, we ask: Does training in AI affect PhD students’ careers? To add further insight into the debate on the privatization of AI research (Jurowetzki et al., 2021), among those who pursue a research career: Do PhD graduates with AI knowledge end up in the private sector? and What is the impact of having AI knowledge on their scientific productivity, visibility, scientific network, and international mobility?
Our study considers field heterogeneity by separating fields in which AI knowledge can be easily acquired after graduation (Nelson and Winter, 1982), i.e., Computer Science, from fields in which learning AI during the PhD is expected to be a unique occasion for acquiring AI knowledge. Indeed, the theoretical, methodological, and empirical knowledge base developed during a PhD in Computer Science is similar to the one required to easily learn AI knowledge after graduation. On the contrary, for PhD graduates in fields other than computer science, e.g., a PhD in Biology, the theoretical, methodological, and empirical knowledge base developed during the PhD is far from the one required to easily learn AI knowledge after graduation.
Methods
To assess if AI training affects PhD students’ careers, we draw on a unique dataset covering the entire population of 46,657 French PhD graduates in STEM disciplines between 2010-2018. We leverage the national centralized archive of French PhD dissertations maintained by the Bibliographic Agency for Higher Education to extract the biographic information on PhD graduates (full name, graduation institute, defense year, supervisor name, and discipline of graduation) and the thesis text (title and abstract). We rely on the OpenAlex database to gather the bibliometric records of PhD graduates and supervisors (the published articles with their title, abstract, publication year, and author list). To reconstruct the fundraising activity of supervisors, we collect the individual grants awarded by the National Agency of Research, the main funding source for French researchers. Lastly, we use data from the European Patent Office to retrieve detailed information on patents whose inventors’ names match those of our PhD graduates, including the application filing year, the inventor’s name and country, and the applicant institution type (private versus public).
We leverage access to the PhD theses to identify PhD graduates with AI knowledge as those who completed a thesis listing at least one AI keyword in the title or abstract. To identify AI keywords, we rely on both lists proposed by Cockburn et al. (2018) and the OECD (Baruffaldi et al., 2020; Calvino et al., 2023). We reconstruct careers and scientific outcomes using patent and publication data. PhD graduates who pursue a research career are those who publish at least one paper or file a patent in the 5 years after graduation. Among those graduates who pursue a research career, we identify PhD graduates working in the private sector if they are affiliated with an R&D department of a private company. To assess graduates’ scientific outcomes, we count the number of publications and patents, number of coauthors, and citations received. To assess international mobility, we use the affiliations listed in the publications to identify those who move abroad.
Establishing a causal link between training in AI and career outcomes is challenging because students who developed AI knowledge during their PhD might differ from other PhD graduates. The differences between the two groups may also affect their careers after graduation. In our study, we overcome this concern and provide causal evidence by implementing a Propensity Score Matching (PSM) approach. For each PhD graduate who developed a thesis in AI, we find a ‘control’ graduate with similar characteristics but not having developed an AI thesis. We match AI graduates with similar controls considering the supervisor’s characteristics, such as mentorship experience, publication records, previous AI knowledge, connections with the private sector, and fundraising experience. We also consider student’s characteristics such as the university and discipline of graduation and the defense year.
Main findings
Our PSM exercise shows that AI knowledge does not significantly affect the probability of pursuing a research career for graduates, both in Computer Science and other fields. However, AI students in Computer Science are less likely to end up in the private sector than their non-AI counterparts. Having AI knowledge is detrimental to patenting activity in Computer Science, while fosters patenting activity in fields other than Computer Science. Moreover, for those students who had an AI training during the PhD, we observe for all fields a significant path dependence in continuing publishing on AI topics after graduation. Finally, we do not observe significant differences between AI and non-AI trained students when looking at their scientific productivity, visibility, and professional network. However, we observe that AI training stimulates mobility to other countries after graduation in fields other than Computer Science.
Training researchers to engage in policy in the U.S.: Mapping the growth and diversity of program models
ABSTRACT. Background and rationale
Since World War II, the relationship between U.S. science and policy has evolved in the face of continual societal and technological change. The social contract for science and the prioritization of basic research funding forged in the aftermath of the Manhattan Project lasted for only a brief period after the war. While scholars debate the timing and precise characterization of subsequent science policy paradigms, they describe a normative trend toward production of knowledge for societal utilization—including governance—by a wide range of actors and sites outside of academia. Facilitating these forms of knowledge creation and exchange requires new practices and entities, for which scientists and engineers typically don’t receive any training or incentivization. The establishment of new U.S. programs to engage academic researchers in policy has grown at an exponential rate with many more opportunities available in the last few years for these groups to participate in training and direct placements within government, or government affairs, offices. This recent trend suggests that an evolution of the science-policy interface may be occurring, but there is little extant data on the structure, aims, and impacts of these programs. A new database we created describes the current landscape of U.S. programs seeking to train academic researchers to engage in policy. Further, we focus on a case study of a state with a substantial number and diversity of programs to characterize the nature of these interventions: how they conceptualize audiences, activities, and impacts; and which researcher roles in policy and forms of decision-maker evidence use they address. Through these data we illustrate the scope and dimensions of these initiatives, with implications for national U.S. research and governance.
Methods
To develop the database of U.S. science policy programs, we first identified data repositories such as the National Conference of State Legislatures and the National Science Policy Network, along with inputs from professional networks. We reviewed program websites for eligibility and collected additional details, subsequently contacting program leaders to verify the data. The database includes programs seeking to promote researchers’ engagement in policy processes, categorized based on activities and governance focus. We utilized the national database to identify existing science policy programs in Virginia and conducted pre-surveys and interviews with program leaders.
Results
In our landscape mapping of U.S. science policy programs, we identify a substantial number (n=174) and broad diversity of programs that have emerged to engage researchers in policy processes, with the majority operating at the state level (n=99, 56.9%). Approximately half of programs at the state level are student organizations (50.5%), rounded out by government placements and fellowships (21.2%), academic certificates, degrees, and trainings (23.2%), and a network serving several science policy groups (1.0%). In contrast, at the national level, the preponderance of science policy programs are fellowships that place researchers in government (64.0%) or in government affairs offices (21.3%), followed by professional development and training opportunities (14.7%), and policy networks (2.7%). The growth in student organizations speaks to a rapid expansion of interest in science policy among early career researchers, driving the need for many other types of opportunities across the United States.
The nationwide science policy program database includes 13 from the Commonwealth of Virginia—academic certificates/degrees/training (6), student organizations (5), and government placements/fellowships (2)—the highest number in any state. Our data show through a pre-survey and interview with each program leader, that even though, at first glance, these programs reflect diverse models for ways to engage researchers in policy, they have many of the same goals for long-term impacts, similar conceptualizations of important audiences and activities, and shared philosophical orientations toward appropriate roles for scientists and engineers in policy and the nature of evidence use in policy. Furthermore, while these programs espouse evidence-based decision-making processes in governance, leaders find it challenging to identify tools that could allow them to implement long-lasting, effective approaches within their programs and to assess their impacts.
The long-term desired impacts Virginia’s science policy programs are seeking, based on our interviews with program leads, fall across four overarching domains: academic institutions, government policy processes, researchers' engagement in policy, and workforce development and training. While these programs may initially seem quite different based on audience, length and depth of program engagement, and type of activities undertaken by participants, they have much in common. When subdivided into 20 desired programmatic impacts, having “more scientists in policy” and facilitating “government employment of scientists” were most frequently cited. And leaders of all programmatic types—academic, student-run, and immersive government placements—seek to influence policy change as a long-term program impact.
Significance
These findings suggest possible opportunities to scale and disseminate promising practices within this rapidly growing ecosystem. Supporting evidence-based approaches could both maximize programmatic effectiveness and advance our knowledge of how science-policy interfaces change and adapt over time. New capacity could be marshaled by building a broader network for shared learning between different types of programs and through partnerships between program leads and social scientists with expertise in the use of research evidence, policy processes, evaluation, and education.
How to strengthen the role of STI policy for climate change? The mapping of the capabilities and opportunities of science and technology on climate change in Uruguay
ABSTRACT. This work situates in the field of Science, Technology and Innovation Policy Studies, and its role to advance into sustainable human development processes (Arocena and Sutz 2003, Arocena and Sutz 2009, Sutz 2010, Alzugaray, Mederos et al. 2011, Arocena and Sutz 2012, Cozzens and Sutz 2012, Arocena 2019, Sutz and Bértola 2020). The study of science, technology and innovation is permeated by deep tensions regarding development dynamics, models of economic growth, production and consumption that today define western societies. At the same time, the current context poses dilemmas and challenges in multiple levels, where planetary instability is on the rise (UNDP 2020). Global wealth is increasingly unequal (Chancel, Piketty et al. 2021), strong unsustainable patterns perpetuate while other social and not as visible pandemias remain, as child labor, political polarization, and profound challenges that prevent the preservation of fundamental human rights (Giuliani 2018). References to civilization crisis, turning point (Biggeri, Clark et al. 2019), Anthropocene risk (Keys, Galaz et al. 2019), era transformation (Naciones Unidas 2016) point in the direction of the urgency for the development paradigm towards sustainability and social inclusion, with a long term approach. It is not clear how to process these transformations that challenge not only everyday life, but our institutions, principles and values, ethical imperatives, regarding human relationships but not only, also affecting non-human and environmental relationships in the path towards life forms that operate within safe planetary boundaries (Rockström, Steffen et al. 2009).
Even if the STI policy has gained an explicit space within the Latin American policy concert (Dutrenit, Aguirre-Bastos et al. 2021), the legitimacy is clear at the discursive level, but its intertwinement and embeddedness into crucial development aspects is still missing (Dutrenit and Sutz 2013, Bianchi, Bortagaray et al. 2021, Bortagaray and Aguirre-Bastos 2021). Furthermore, it is not evident what is best governance scheme to better advance in this direction, to foster the necessary changes across the policy spectrum placing STI as a fundamental driver of change. What type of policy space should STI have within the overall policy spectrum? Should it be organized as a discrete policy domain, or should it be designed in a way that cuts across others like agriculture, health, industry, social development? What scope, governance models and systems better serve such transformation, and with what specific policies, institutional arrays, and the extent to which they need to be changed or created? (Sachs, Schmidt-Traub et al. 2019). Current societal challenges are profoundly complex and novel, calling for flexibility, adaptation, experimentation and policy learning. STIP key (new) role is part of a “normative turn” (Daimer, Hufnagl et al. 2012), a paradigm shift in STI policy with growing importance of directionality and normativity in STI, and an instrumental role of STIP for solving societal challenges, and advancing sustainable human development.
This work aims at contributing to the overall discussion of STI policy with a specific focus on climate change. Even though the study has a national scope, the discussion and insights could be of international interest given the global character of climate change. More specifically, it has a twofold objective. First, the goal is to discuss a methodological approach to identify and assess the national research capabilities to then analyze the academic and policy needs that should be considered if tackling the national agenda on climate change. Secondly, and based on the study of the capabilities on climate change research in the country and the emerging opportunities, this work discusses a series of areas and knowledge gaps when it comes to advancing the decision-making processes on climate change in the country. For the identification of capabilities and opportunities related to climate change S&T, it is necessary to start from a perspective of complexity, which prioritizes the relevance of knowledge and innovation “for mitigation and adaptation to climate change and variability, as well as to reduce and adequately integrate uncertainties in decision making related to current impacts and future risks of climate variability and change” (Sistema Nacional Ambiental, Gabinete Nacional Ambiental et al. 2017). The work is based on different sources and types of information to account for the complexity that characterizes the identification of capabilities, opportunities and gaps in knowledge and innovation in climate change. Secondary information gathered from policy documents including plans and reports, complemented with data from a list of research proposals on climate change funded by the National Agency of Research and Innovation (ANII), and the University of the Republic between 2012 and 2021. Furthermore, the empirical analysis also relies on academic publications on climate change by authors whose organizational affiliation is located in Uruguay, from Scopus and Web of Science databases. Primary data gathered from in-depth interviews to qualified informants (first semester of 2022) is complemented with information from a survey to decision-making referents through an electronic form (second semester 2022).
In summary, this work seeks to map the knowledge and policy needs related to climate change in Uruguay, understand the existing knowledge and innovation capabilities on climate change in the country, in order to identify the major dimensions around knowledge and innovation gaps in this area, to better grasp the potential role of the STI policy in relation to climate change, and the multidimensional and complex character of current development challenges.
Understanding the role of STI policy rationales in the Latin American and Caribbean context: the case of the Dominican Republic
ABSTRACT. This work examines the influence of different economic rationales in the Dominican Republic's (DR) science, technology, and innovation (STI) policies from a development context perspective, focusing on the design phase of the current Dominican STI policy framework. This work focuses on the influence of economic rationales to understand the formal construction of the contemporary Dominican STI policy platform, considering different economic policy cycles as contextual factors in creating an STI policy discourse as an element of development policies in one of the most dynamic developing economies of Latin America and the Caribbean. For this purpose, four STI policy frameworks are reviewed: the National Competitiveness Plan (PNC), presented in 2007; the Strategic Plan of Science, Technology, and Innovation 2008–18 (PESCYT), introduced in the fall of 2008; the Ten-Year Plan of Higher Education 2008–18 (PDES), presented in 2008; and the National Development Strategy 2030 (NDS), introduced in 2012.
The following questions are raised regarding these frameworks: What are the main rationales of the Dominican's STI policies? To what extent have the STI policies influenced this period? Given that four specific STI policy frameworks are considered in this work, it is necessary to highlight that STI policies generally do not operate independently. In its formulation, execution, and performance interact with and are affected by other policy frameworks. Limiting the current analysis to the four indicated STI policy frameworks is a decision to simplify the analysis and narrow it down in terms of its methodological scope. While recognizing the need for more complex analyses that deepen the structural, functional, and systemic interdependence of STI policies as part of the inherent complexity of innovation systems, it is imperative in the context of Latin American and Caribbean (LAC) countries.
Considering the LAC context, this work covers three cycles of STI policies in the DR. The first is the industrialization and import substitution cycle, corresponding to the development policies from the late 1960s to the late 1980s. The second one is the structural adjustment cycle, which is related to the regional influence of the Washington Consensus in the 1990s. Finally, the third one is the post-structural adjustment cycle from the twenty-first century's first decade. The main interest of this article is the third cycle since it was the period in which the current DR's STI policy frameworks emerged and gained political space.
From the methodological perspective, the identification of the rationales of the four frameworks of the STI policies of the DR started from a qualitative approach based on ground theory. Generally, grounded theory consists of an inductive method to construct a theory based on systematic review and data collection. Once the data are collected, a systematic review tends to support the discovery of theories based on the data. It builds a general description, which simultaneously fits with the theory and the data from which it emerges. The grounded theory approach tends to start with a couple of research questions about the phenomena under study, subject to an intense interaction between the data-gathering process and the analysis, making this approach suitable for the context.
Concerning the first research question raised in this article, and within the limits of the grounded approach in the Dominican STI policy frameworks, three rationales prevail: (1) a systemic–institutional nature, (2) a neo-Marshallian approach, and (3) a close-up Schumpeterian growth perspective. This general composition somewhat recognizes the systemic and institutional failures that still affect the growth and development potential of the country. However, it seems that this negative cycle can be broken through concerted policies, transparency, and considering a medium- to long-term STI policy formulation perspective.
Concerning the extent of the STI policy's influence on the Dominican economy's performance in the analyzed period, and without a proper evaluation of the impact of STI policies, it is not straightforward to determine the extent to which they contribute to economic growth and performance dynamics. Various factors, such as a favorable national and international macroeconomic environment, an increase in foreign direct investment, economic growth driven by aggregate domestic demand, tourism growth, and an increase in exports, can undoubtedly explain the prolonged growth cycle with greater robustness. However, there is no doubt that STI policies play at least a cultural role in defining a new approach to development policies in the DR. One possible hypothesis may be that STI policy frameworks have a latent effect (e.g., cultural, political, and institutional) when boosting and supporting economic growth in combination with other structural and cyclical factors. Another hypothesis could have a more direct effect, primarily through instruments and initiatives derived from the PNC, such as the neo-Marshallian influence in supporting SMEs and clusters through the creation of 'centropymes.' This is an interesting attempt to create nationwide SME–university–government interfaces. Such hypotheses, however, must be corroborated with further analysis.
In sum, rationales are not necessarily inserted into a specific policy framework without an explicit intention from the agents involved in STI policymaking. On certain occasions, this intention may be explicit, but it depends on the country's context and the interactions of the public policy agents.
The complex multilevel STI policy system built during the period covered in this article cannot be adequately assessed without creating an evaluation mix and conducting exercises, which are far from the purpose of this article. However, what can be achieved are more meditative, prospective, and general exercises regarding the possible contributions of the STI policies to the country's growth performance. In this regard, understanding the rationales of the Dominican STI policies sheds light on how to develop this evaluation mix, define the next generation of STI policies, and align them with sustainable development goals to boost productivity and competitiveness.
In terms of challenges and opportunities, there are at least four elements for the next generation of STI policies in the DR that could be briefly commented on: (1) overcoming coordination failures and improving governance; (2) rethinking business–university relationships; (3) incorporating an STI policy demand approach; and (4) applying a regional and multilevel approach to innovation systems.
Science, Technology and Innovation (STI) Policy: An imperative for Small Independent Developing States (SIDs) within the Caribbean
ABSTRACT. Caribbean Small Independent Developing States (SIDs) face enduring economic challenges, including limited resources, geographic isolation, and structural vulnerabilities that constrain sustained growth and development. This paper examines the potential of Science, Technology, and Innovation (STI) policy as a mechanism to promote socio-economic transformation in Caribbean SIDs. Building on recent advancements in innovation policy and systems theory (Audretsch, 2007; Malerba, 2004; Seto et al., 2016), this study aims to address a pressing research gap: How can STI policies be strategically designed and implemented to drive economic transformation in the Caribbean SIDs context?
The research is motivated by the critical need for Caribbean SIDs to diversify their economies and enhance resilience amid ongoing global economic and environmental pressures (Suárez & Erbes, 2021; Vargas & Darrow, 2023). Recognizing a gap in existing literature on STI policies tailored specifically for small economies, this paper adopts a multi-method approach that includes a systematic review of current STI policy frameworks, data analysis from Caribbean case studies, and comparative analysis of innovation systems in similar contexts. The study employs Systems of Innovation (SI) theory (Edquist, 1997), specifically exploring sectoral systems of innovation(SSI; Malerba, 2004), national systems of innovation (NSI; Nelson (1993), Lundvall B (1992), Freeman C. (1981), and regional systems of innovation (RSI; Cooke, 2001), to develop a multi-level policy model that addresses structural challenges faced by SIDs.
This paper contributes to the literature by offering a policy framework tailored to the institutional and economic constraints characteristic of Caribbean SIDs, where traditional STI approaches may not readily apply. The model provides detailed policy recommendations designed to mitigate capacity limitations, institutional fragmentation, and sectoral dependencies. Furthermore, the study advances a SI-based model that facilitates scientific and technological integration within small economies, promoting pathways for sustainable economic growth and resilience (Gómez-Valenzuela, 2020; Weber & Rohracher, 2012). Data to support proposed models will be supported by secondary data sources and robust literature review on developing economies.
In conclusion, this research underscores the importance of adaptive, innovation-driven policies for Caribbean SIDs and provides a strategic framework for advancing long-term resilience, economic stability and competitiveness in a rapidly changing global landscape. This framework addresses the specific needs of SIDs and contributes to broader STI policy discourse by emphasizing the potential of innovation systems in fostering socio-economic resilience in resource-constrained economies.
Establishing a Customized Evaluation Framework for High-Challenge, Innovation-Driven R&D Programs Abstract in South Korea
ABSTRACT. High-challenge, innovation-driven R&D initiatives—marked by complexity, uncertainty, and significant potential impact—require a customized evaluation framework that goes beyond traditional assessment methods. Despite recent policy adjustments, such as removing penalties for rigorously conducted but unsuccessful projects, researchers still perceive limited support for ambitious, high-risk research within government R&D systems. Standard evaluation frameworks often fail to capture the unique attributes of high-risk R&D projects, resulting in a lack of proper recognition for projects with transformative potential.
To address this, we propose a formative, mission-oriented evaluation framework that aligns with evolving policy and technology landscapes, thus enabling projects to achieve mission-specific objectives and generate high-value outcomes. Our framework builds upon best practices from national fiscal evaluations and international methodologies, introducing assessment criteria that emphasize goal setting, risk management, milestone tracking, and adaptable governance. This tailored approach prioritizes key areas including research planning (goal setting, portfolio strategy, adaptability), execution (collaborative governance, monitoring), and outcome generation (scientific, economic, societal impact, and unanticipated benefits).
To validate this model, we suggest pilot implementations in strategic technology projects, such as next-generation semiconductors or advanced nuclear technologies. This customized evaluation framework aims to foster an environment conducive to breakthrough innovations, ultimately enhancing the alignment and effectiveness of national R&D investments toward strategic objectives.
Behind the Scenes of Policy Implementation: The Professionalization of Boundary-Spanning Roles
ABSTRACT. The roundtable examines the critical, yet often underexplored, roles of "boundary-spanning" professionals—those who bridge the divide between policy development and implementation within innovation ecosystems. This group includes technology transfer specialists, evaluators, consultants, and project managers. The Boundary-Spanning Theory—originating from Tushman (1977) and applied in various policy and organizational studies—explains how these professionals facilitate interactions and knowledge exchange across organizational and cultural divides, thereby driving the effective translation of policy into practice.
In the context of innovation policy, these roles are essential for implementing public-private partnerships, disseminating research, and managing complex, cross-sector projects. Boundary-spanners act as conduits for both technical expertise and institutional knowledge, ensuring that innovation policies achieve their intended impacts. This panel will discuss:
- How these boundary-spanning roles have professionalized within the policy life cycle? - The distinct skills and competencies that are crucial for success in these roles? - The ways that boundary-spanners contribute to a more agile, responsive policy implementation process?
Additionally, the panel will explore the broader implications of these roles for building a resilient and adaptive innovation ecosystem. The need for boundary-spanners reflects an underlying shift in how innovation policies are conceived and executed, emphasizing collaboration, accountability, and inclusivity. Panelists will discuss how organizations can foster environments that empower these professionals, such as creating clearer pathways for career advancement and providing resources for ongoing skills development.
The session will draw insights from case studies across academia, government, and industry, illustrating how boundary-spanners have contributed to successful policy implementation in diverse contexts. For example, technology transfer offices in universities often bridge the gap between academic research and market applications, while evaluators and consultants ensure that policies meet their intended goals by providing rigorous assessments and recommendations.
By examining both the organizational and human dimensions of boundary-spanning roles, this panel will provide actionable insights into how the workforce can adapt to meet the challenges of modern innovation policy. Attendees will leave with a deeper understanding of how these professionals drive the success of complex initiatives and how investments in their training and development can strengthen the broader innovation ecosystem.
Does gender matter for career progression progression in public research organizations?
ABSTRACT. Women are underrepresented in science across most countries, particularly in senior roles.
Our study investigates one of the possible factors contributing to the persistent gender differences in top academic and scientific positions, namely bias in the evaluation for promotion to full professor and senior researcher.
We study gender differences in promotion probabilities at the Spanish National Research Council (CSIC) in a five-year period from 2017 to 2021.
We analyze 90 different promotion events evaluated by singular/independent evaluation panels, across scientific fields. Those include 2338 applicants and 397 members of evaluation committees.
We address three research questions:
1. Whether merit factors (and which ones) positively and significantly affect individual promotion probabilities.
2. Whether the gender of candidates is a significant factor when other relevant variables are considered.
3. Whether there are factors associated with the composition of the panels and the design of the promotion process that affect unequal probabilities for candidates.
Our study provides the opportunity to study promotion processes in an institutional setting characterized internal competition and based on a contest-type process, different to the one predominant in the US research university model most typical in a large part of the international literature, namely, the tenure-track model, where, moreover, hiring and promotion evaluation takes place at department level. In contrast, in the model analysed in this paper evaluation panels operate at the level of the position specialty and include external as well as internal members from several institutes.
Understanding how competition levels are influenced by organizational decisions, such as the distribution of positions across scientific fields and categories, enhances our insights into how organizational practices impact individual promotion probabilities, especially in contested systems where the probability of promotion depends on the number and characteristics of competitors
We have created two different data sets; one of applicants, combining personal and career information with scientific performance data (publications, citations, impact, projects, contracts, patents, and PhD supervision) and another one of Evaluation Panel members.
For the analysis, a unique database of the 2,358 candidates has been created, incorporating demographic, career and merit variables; a database of the members of the evaluation panels who have participated in the evaluation processes has also been built.
These two databases have been linked through the joint occurrence of evaluators and applicants in the event of every contest for the promotion positions.
We have integrated the two data sets for each of the 90 evaluation panels and generated additional indicators such as share of females’ evaluators in every panel and connections between applicants and Panel members.
Some characteristics of the promotion processes (number of available positions and its allocation by field areas) condition the promotion probability of candidates, so calls corresponding to 5 years have been selected with different levels of success rates, for 2 senior scales, with 90 different scientific profiles (from different scientific areas) with evaluation committees, etc.
Using logistic regression models and estimating predicted probabilities, we address the questions of weather gender plays a significant role in promotion probabilities, the role of merit, and the effect of competition and panel composition and connections with applicants.
We do not find consistent evidence of systematic gender biases in the promotion processes. Evidence shows that female and male applicants possess comparable qualifications and merits. While we find that gender is not relevant to explain individual promotion outcomes, scientific achievements (specially research funding and impact) are important predictors of promotion probabilities across genders.
The merit factors introduced in the model have positive effects (most of them), although some are not significant. Of all the merit factors, it turns out that the most important factor for both promotion categories is, firstly, " being the IP of research projects" either considering the number of projects and/or volume of funding (ln), and secondly, the citations (fractional count) received by candidates.
Our findings reveal additional influential elements beyond scientific merits. Specifically, institutional proximity between applicants and evaluators is a relevant significant factor, in addition to the effects of competitive pressure within each promotion event, however those effects are not gendered.
We find a powerful and regular effect in favor of the probabilities of candidates who have an evaluating member from their own institute in the panel. Having a member from the own institute in the evaluation panel (a measure of institutional proximity) significantly increases promotion probabilities (for both sexes), by almost 50% compared to those with similar characteristics but without that evaluator from the same institute.
Another interesting finding is that when there is more than one candidate from the same institute, their promotion probabilities are reduced, limiting the positive effect of having a colleague of the same institute on the panel.
Our Contribution
First, our study is not sample, it provides an analysis of all promotion processes and therefore covers different fields. Few studies have previously simultaneously addressed a variety of scientific fields.
Second, while other studies have focused on specific phases of academic careers, with a predominance of access to tenure, we address promotions at two different senior scales, corresponding to different career phases, offering complementary insights into the factors that influence progress to the highest academic ranks.
Third, we have diversified the indicators of the merit of applicants, expanding beyond bibliometric ones.
Fourth, the analysis focuses on a large research institution (CSIC), with scientific and technological research as the main mission, avoiding measurement problems associated with teaching loads.
Fifth, although recent studies already included the analysis of evaluation panels (especially referring to funding agencies), the incorporation of relevant attributes of evaluation panels’ members is not yet not common in promotion studies.
Finally, from the policy side, some of our results raise concerns about the fairness of the promotion process. We discuss the findings and some organizational policy implications, highlighting the importance of examining not only individual level factors but also process and structural ones.
ABSTRACT. Media plays a significant role in communicating scientific discoveries to the public and possesses the power to influence the public perception of science and science policies. The representation of diverse groups of scientists and their research is one of the basic concerns of equity in science journalism. Existing studies suggest systematic gender bias in media coverage of science can affect the citation, funding, collaborations, and career advancement opportunities for certain groups of scientists and influence young individuals' career choices. Such biased coverage of science based on gender not only hinders the communication of diverse scientific topics but also creates a biased view of who can be a scientist. Therefore, understanding and addressing gender bias in science coverage is essential for fostering a more informed and equitable public discourse on scientific issues. In this study, we intend to investigate the existence of gender bias in media coverage of scientific research.
This study primarily relies on data from altmetric.com (Altmetrics) and Scopus. We selected the top 25% of journals indexed by Altmetrics with the highest news mention number for each of the 20 fields specified by the Science-Metrix classification and collected the DOIs associated with those journals. For these DOIs, we collected the news citation data from Altmetrics. We limit our analysis to the 1,014,077 unique articles published between 2018 and 2022 within the United States.
To evaluate the impact of gender on media citations, we created a matched sample of articles that were not cited in the media (control group) but exhibited similar characteristics to those cited in the media (treatment group) using Coarsened Exact Matching (CEM). The characteristic list includes publication year, publication venue, subfield of the article, number of authors in the author list, and open access status. Our analysis reveals that in fields such as Historical Studies, Mathematics & Statistics, Biomedical Research, Social Science, and Public Health & Health Services, the proportion of women corresponding authors is notably lower in the treatment group. Conversely, we observe a higher proportion of women corresponding authors in fields such as Economics & Business, Philosophy & Theology, and Agriculture, Fisheries, and Forestry.
We conducted a weighted binary logistic regression analysis using the CEM weights. Our analysis suggests mixed results. While male corresponding author papers are significantly more likely to be cited in fields like Public Health & Health Services and Social Science, we see female corresponding author papers to be significantly more likely to be covered in Economics & Business, Information & Communication Technologies, Agriculture, Fisheries & Forestry, and Psychology & Cognitive Science. This pattern of media coverage draws an interesting connection between media citation and the gender equality paradox. In fields with a higher representation of women corresponding authors, papers by women are less likely to receive media citations. In contrast, fields with a lower share of women corresponding authors show an increased likelihood of media citation for papers authored by women.
We further compared the raw number of media citations received by papers with women versus men as corresponding authors, focusing only on papers with at least one media citation. Our analysis reveals a difference in the average number of media citations, favoring male corresponding authors across all five domains. We conducted a regression analysis to find the association between gender and raw media coverage count while controlling for year, team size, the subfield of the article, and journal quantile across domains. Our analysis suggests that male corresponding authored papers receive a significantly higher number of media citations across the majority of the domains.
We analyzed the correlation between the gender of the corresponding author and the likelihood of being cited across different media types: local, national, international, and specialty. Our findings suggest that the proportion of women corresponding authors is higher in the locally cited group than in the nationally, internationally, and specialty cited groups, indicating that women corresponding-authored papers receive more citations than the control group in local media, while other broader-reaching outlets and specialty media cite more men corresponding-authored papers. We also assess the impact of the gender of the corresponding author on the ideology of the media outlet. Our regression analysis suggests that papers by women corresponding authors are more frequently covered by outlets with a liberal ideological stance compared to papers by male authors for overall trend and in Natural Sciences, Health Sciences, and Economic & Social Sciences.
To estimate the impact of gender on different types of sentiment scores, we predicted sentence-level sentiment scores for each news article. Using the model, we predicted sentence-level positive, negative, and neutral sentiment scores. We conducted regression analysis at the sentence level, holding control variables constant. Our analysis reveals that papers with men corresponding authors received significantly higher positive sentiment scores in media coverage, both in the overall trend and specifically in Applied Sciences and Health Sciences. Additionally, we found that papers with men corresponding authors received significantly higher neutral sentiment scores overall. Conversely, papers with women corresponding authors were cited in media with significantly higher negative sentiment scores, with this trend holding across Applied Sciences, Health Sciences, and Natural Sciences. However, Arts & Humanities presented an exception: in this field, papers with men corresponding authors were associated with significantly higher negative sentiment scores. These findings indicate that media coverage sentiment may be influenced by the gender of the corresponding author, with women-authored papers being more often associated with negative sentiment, suggesting potential gender bias in media coverage of science.
Overall, these results point to systemic issues in the representation of scientists in media. The existing gender difference in media citations and sentiments may perpetuate gender disparities in scientific recognition and public influence. Addressing these biases is crucial for fostering equitable representation of scientists across genders. Media outlets and journalists should critically evaluate their reporting practices, ensuring that coverage fairly reflects the significance and quality of research regardless of the author’s gender.
Gender Disparities in Academic Publishing in the Era of Generative AI: A Bibliometric Study
ABSTRACT. Persistent gender disparities in academic publishing—such as citation gaps, gender-homogeneous collaboration networks, and regional imbalances in research contributions—have been well documented (Prakash et al., 2024). Female scholars, despite increasing representation in certain fields, continue to face systemic disadvantages, including lower citation rates and insufficient recognition for their contributions. These challenges persist across disciplines and regions, reinforcing structural inequalities in academia.
The rise of Generative Artificial Intelligence (GenAI), particularly with tools like ChatGPT, offers a unique opportunity to disrupt these entrenched patterns by democratizing research processes. By lowering linguistic and methodological barriers, GenAI tools have the potential to expand access to scholarly production and foster inclusivity. However, their impact on existing gender disparities in academia remains unclear. This study seeks to investigate whether the adoption of GenAI serves to mitigate or amplify these inequities.
In particular, our research addresses three sub-questions: (1) How has the introduction of GenAI tools affected gender-based collaboration patterns and authorship in academic publishing? (2) To what extent does GenAI influence the distribution of scholarly recognition and impact along gender lines? (3) Does the democratizing potential of GenAI tools manifest differently across disciplines and geographical regions, particularly concerning existing core-periphery disparities in academia?
Through an inductive approach, this study aims to map the emerging pattern of gender inequality in academic publishing following the introduction of GenAI tools. Specifically, this research conducts a large-scale bibliometric analysis of publications from January 2021 to December 2023, sourced from the Web of Science database, encompassing STEM, social sciences, and humanities. Using computational gender inference methods (Goyanes et al., 2024) that integrate tools such as ChatGPT, Namsor, and Gender-API, the study examines the impact of GenAI on gender patterns through critical metrics, including collaboration patterns, authorship roles, recognition, and citation practices, and publishing stratification across journal tiers. The analysis also considers disciplinary and geographical variations to understand how GenAI interacts with existing hierarchies and core-periphery inequalities in global academia.
This mapping exercise makes several contributions to understanding gender inequality in contemporary academia. First, it provides the first systematic documentation of how GenAI is reshaping gender disparities in academic publishing. Second, it identifies new forms of inequality beyond the simple Matthew effect that may require policy intervention. These findings provide crucial insights for policymakers and academic institutions promoting gender equity in an increasingly AI-mediated research landscape. By mapping emerging patterns of inequality, this study helps anticipate and address new forms of gender disparity before they become entrenched in academic practice.
Place-Based Innovation as a Mechanism for Equitable Development and Strengthening Democratic Foundations: U.S. and European Experiences
ABSTRACT. This panel will examine factors relevant to new investments in regional place-based innovation initiatives. Many of these programs target regions that have not traditionally been innovation hubs with the goal of expanding economic and other opportunities for these communities. These investments in "smart innovation"—a collaborative, equity-centered approach to innovation—are a strategy for reinforcing democratic foundations and fostering regional resilience. In the current landscape, characterized by socio-economic divisions and structural disparities, "smart innovation" provides a model that emphasizes shared benefits and cross-sectoral partnership to address regional needs and foster inclusivity. The panel will explore how frameworks like the Triple Helix Model, Knowledge Spillover Theory, Institutional Logics Theory, Boundary-Spanning Theory, and models of Co-Production reveal both challenges and pathways for realizing democratic goals within innovation policies.
The Triple Helix Model underscores the need for interconnectedness among academia, industry, and government, suggesting that balanced partnerships across these sectors are key to aligning innovation initiatives with democratic values and inclusive economic development. However, divergent institutional logics—where government regulations, academic objectives, and industry imperatives may clash—pose significant obstacles. Using Institutional Logics Theory as a backdrop, the panel will discuss strategies for mitigating these tensions to foster cohesive policy alignment that serves public interests.
Central to this discussion is also the role of knowledge spillovers, where technological and organizational insights flow between entities, generating broader economic and social benefits. Knowledge spillovers—first discussed in economic and innovation literature by Griliches (1992) and expanded upon by Link and others—are crucial for creating dynamic, resilient innovation ecosystems. The panel will examine how government bodies, academic institutions, NGOs, and private industry can collaboratively ensure that the benefits of innovation extend to regions that might otherwise be left behind.
Boundary-Spanning Theory further illuminates the importance of individuals and organizations that bridge these sectoral divides, ensuring cohesion between varied stakeholder goals. These "boundary spanners" facilitate knowledge exchange and collaboration across traditionally isolated groups, fostering a shared understanding that is essential for smart innovation to thrive. Finally, these initiatives often challenge individuals and organization to engage in knowledge co-production in order to meet regional needs. Co-production presents additional challenges in the dynamics of how partners from multiple sectors work together to advance regional opportunities and impacts.
Using examples from regional development projects like NSF programs, rebuilding due to conflict and natural disaster, and global innovation initiatives overall, we will discuss:
- How do we design inclusive policies that adapt to both local and national priorities?
- What are the key components of a sustainable, democratic innovation ecosystem?
- How can metrics be established to measure the societal impact of innovation, beyond traditional economic metrics?
Panelists will address these questions by examining different stakeholders’ roles in fostering knowledge-sharing and democratic accountability.
Altogether, this session positions "smart innovation" as a vehicle for resilience and democratic stability by embedding equity, accountability, and collaborative governance into innovation-driven development. The panel will engage participants in discussion on how these frameworks can serve as guides for both policy design and implementation in ways that strengthen democracy and build sustainable growth at multiple levels.
Navigating the Tightrope: Balancing Openness and Security in European Research
ABSTRACT. This paper will look at attempts in a selection of European Union member states, and the UK, to balance internationally collaborative research activities and a commitment to open science with the perceived need to consider issues of research security and ‘responsible internationalisation’ in a new era of economic and geopolitical competition. National security and economic security concerns have been a key driver of national research policies in most countries, but over many decades international mobility and collaboration have increased in importance, shaping the emergence of a globalized science system (Wagner, 2009). Governments have historically often attempted to restrict the flow of technological artefacts, codified knowledge and tacit know-how in order to maintain technological leadership, but today’s globalized science system and a renewed interest in ‘open science’ and open data makes the challenge of doing so much more complex.
European nations differ significantly in the level of internationalization of their national public research systems, in the institutional configuration of those systems, and in terms of how developed policies and practices are in relation to research security, but the issue of research security is rising rapidly on the policy agenda of all European countries and awareness, and good practice is increasingly being promoted through the action of international bodies such as the European Comission, OECD, and G7, and through organisations such as the League of European Research Universities (LERU). For instance, in January 2024, the European Commission Council Recommendation on Research Security highlighted a need to enhance research security across Europe and also announced the creation of a European centre of expertise on research security, and work on tools to support research performing organisations and reforms to the EU’s ‘dual-use’ export control regime. For its part, the UK has built a relatively sophisticated system of research security measures through close collaboration between government, security agencies, research funders and universities. However, there is little international comparative research on research security concerns and responses (Shih, Chubb and Cooney-O’Donoghue, 2024).
The term ‘research security’ is commonly used in, and well understood by research system actors in the UK and other Anglophone countries, but ideas around ‘trust’ and ‘responsibility’ also figure in the language that countries use to discuss these issues. For instance, the concept of ‘responsible internationalisation’ provides a more positive take that implies a recognition of the value and importance of continued internationalisation whilst de-emphasising the notion of restrictions on academic freedom to share and collaborate, whilst the concept of ‘trusted research’ links concerns about the protection of knowledge, know-how and IP with concerns about openness, integrity and reproducibility in research.
Based on interviews with research system actors in seven EU member states (Czech Republic; France; Germany; Italy; Netherlands; Spain; Sweden), and documentary analysis, we examine evolving understandings, regulations and practices in relation to research security in the public or quasi-public research base. The seven countries were selected based on two criteria: the importance of their publicly funded research base to the overall European science base; and coverage of a variety of national research systems configurations including one post-Soviet Academy of Sciences-style system. We also draw on interviews at the EU level and with informants from relevant networks of research-performing organisations.
We look at the way different systems are attempting to assess and mitigate perceived risks stemming from international cooperation and the role of science ministries, funding agencies and other key actors in this. We explore how the tensions between ideals around academic freedom (but also pre-existing cultures of practicing research, including research collaboration and sharing of data and knowledge) and new pressures to secure against perceived national and economic security risks of knowledge leakage or theft. We also explore the role of international organisations and networks in shaping perceptions and sharing practices.
The aim of the paper is to draw lessons from the comparative analysis about how the potential tensions between openness and security are perceived, are being managed, and how ‘trust’ in research is being (re)constructed in this new era of responsible internationalization.
Shih, T., Chubb, A. & Cooney-O’Donoghue, D. (2024) Scientific collaboration amid geopolitical tensions: a comparison of Sweden and Australia. Higher Education 87, 1339–1356. https://doi.org/10.1007/s10734-023-01066-0
Wagner, C. S. (2009). The new invisible college: Science for development. Rowman & Littlefield.
Trusted Research: The Uk's Approach to Balancing International Collaboration And Research Security
ABSTRACT. Abstract submitted as part of the proposed thematic session: "As open as possible, as
secure as necessary": A Discussion of the Securitization of World Scientific Research
and Development.
The challenge of maintaining international scientific collaboration while safeguarding national and economic interests has led governments to pay increasing attention to research security. Research security refers to a broad range of issues and risks associated with international research collaboration, including threats to national security and other risks such as attempts by external actors to illegitimately acquire academic research and expertise and/or interfere with academic discourse (G7, 2022).
This paper will examine the United Kingdom’s approach to research security, what the UK government calls “Trusted Research”. Specifically, it will examine these developments through the theoretical lens of collaborative governance, highlighting the tensions and trade-offs between the co-development of research security measures between government, researcher funders and universities and the threat of more adversarial relationships.
The issue of research security is particularly important for the UK since international research collaboration, not least with the People’s Republic of China, plays a key role in UK academic science. Studies suggest that virtually all the growth in UK science (as measured by publication) over the last two decades is accounted for by growth in international collaborative papers, including with China (Adams et al, 2022). At the same time, Chinese students account for around one-third of all UK PhD students in STEM subjects and UK universities collaborate with Chinese institutions in a substantial number of joint research centres (Quimbre et al, 2022).
The paper considers Trusted Research and its core principles. This places an emphasis on the responsibility of individual researchers and institutions in managing risks, promoting informed decision-making, and protecting research from hostile actors. The Trusted Research campaign, led by government but co-developed with university associations and research funding bodies, seeks to raise awareness of threats amongst universities and academic researchers, diffuse good practice with respect to due diligence in the examination of international research collaborations and provide guidance to researchers, university staff and funding organisations (Universities UK, 2022; NPSA, 2024; NPSA, n.d).
The paper examines Trusted Research through the theoretical lens of collaborative governance. In contrast to adversarial and managerial modes of public policy development and implementation, collaborative governance emphasises the role of public, private, and civil society stakeholders working together to achieve common policy goals or solve public issues (Ansell and Gash, 2008). Ansell and Gash define it as:
“A governing arrangement where one or more public agencies directly engage non-state stakeholders in a collective decision-making process that is formal, consensus-oriented, and deliberative and that aims to make or implement public policy or manage public programs or assets” (Ansell and Gash, 2008: 544).
This approach emphasises the importance of shared decision-making, where power and responsibilities are distributed among diverse actors who bring different expertise, perspectives, and resources, ensuring that policy solutions are co-created rather than imposed by a single authority. Collaborative governance often involves structured dialogue, transparency, and accountability to address complex issues that require cooperation beyond traditional government structures. It aims to foster trust among participants and enhance the legitimacy and effectiveness of policy outcomes (Ansell and Gash, 2007; Emerson et al, 2012).
The paper draws on semi-structured interviews with government officials, research funding organisations, university associations, senior university leaders, university research managers and individual scientists undertaken since August 2024 as part of an on-going study on international research collaboration and research security.
The paper will argue that the idea of collaborative governance can be applied to the Trusted Research programme. Since the launch of Trusted Research in 2019, the government has sought to foster partnerships between academic institutions, research funders and government agencies to safeguard sensitive research. University associations, especially Universities UK, have acted as an intermediary between government agencies and universities developing shared decision-making and communication channels among stakeholders to develop policies and procedures that balance the need for open scientific collaboration with national security concerns, such as intellectual property protection and the prevention of foreign interference.
Nonetheless, as the full paper will discuss, Trusted Research has been contested by the university sector, albeit behind closed doors. Universities are alert to the challenges to academic freedom. At the same time, behind the rhetoric of collaboration are very real fears about the reputational consequences of security breaches for universities and the danger of legal sanction for breaches of export control and other legislative provisions.
REFERENCES
Adams J, Johnson J and Grant J (2022) “The rise of UK-China research collaboration: trends, opportunities and challenges”, Science and Public Policy 49:32-147.
Ansell, C and Gash, A (2008) "Collaborative governance in theory and practice”, Journal of Public Administration Research and Theory, 18(4): 543-571.
Emerson, K, Nabatchi, T and Balogh, S (2012) “An integrative framework for collaborative governance”, Journal of Public Administration Research and Theory, 22 (1): 1–29, https://doi.org/10.1093/jopart/mur011
G7 (2022) G7 Common Values and Principles on Research Security and Research Integrity, June 2022.
National Protective Security Authority (2024) Trusted Research Guidance for Academics National Protective Security Authority and National Cyber Security Centre, available at https://www.npsa.gov.uk/system/files/trusted-research-guidance-for-academia-digital-july24.pdf
National Protective Security Authority (n.d.) Trusted Research Guidance for Senior Leaders, National Protective Security Authority and National Cyber Security Centre, available at https://www.npsa.gov.uk/system/files/npsa-trusted-research-guidance-for-senior-leaders_0_1_0.pdf
Quimbre, F, Carlyon, P, Dewaele, L and Drew, A (2022) Exploring Research Engagement with China: Opportunities and Challenges, RAND Europe: Cambridge.
Universities UK (2022) Managing Risks in Internationalisation: Security Related Issues. Universities UK: London.
Research Integrity or National Security: An Explorative Study of the China Initiative
ABSTRACT. The "China Initiative," launched by the U.S. Department of Justice in November 2018 and concluded in February 2022, was a critical and contentious program intended to combat alleged national security threats posed by Chinese efforts to misappropriate U.S. intellectual property, especially within the realms of science and technology. This explorative study delves into cases centered around allegations of compromised research integrity, examining how a multitude of factors interacts to shape judicial outcomes and policy directions.The findings of this study reveal that no single factor is determinative of a guilty verdict; rather, outcomes are the result of complex interactions among various conditions. Key factors identified include the presence of financial ties to China, involvement in China's talent recruitment programs, the nature of the alleged misconduct, and the strength of the prosecution's evidence. The study stresses the need for a delicate balance between safeguarding national security and promoting international scientific collaboration.
Open Science, Intellectual Property, and Tensions in Public-Private Research Partnerships: The Irish Context
ABSTRACT. Introduction
Publicly funded researchers are increasingly under mandates to make their research outputs “open” (Dalipi et al., 2022, and others). However, some outputs arising from publicly funded research can be commercialised, which argues for the need for closure when intellectual property/patents are at stake (O’Mahony & Bechky, 2008). Indeed, some of the funding programs that require open research are also designed to foster commercial activity. The tensions between open research and intellectual property are particularly complicated when research is carried out by public-private research partnerships [PPRP] - i.e., projects between universities and other private sector partners (Perkmann & Schildt, 2015; Lattu & Cai, 2022).
As Cai and Lattu (2023) and others note, even as openness in science has long been an idealized norm of scientific research, such norms have been increasingly been complicated both by the changing nature of research, the values of different research actors/stakeholders, and the pervasive integration of digitalization in all aspects of the research process. In this paper, we explore how tensions among norms of openness and closure are understood and navigated by research ecosystem actors – researchers themselves, technology transfer offices, research support units, funders, and others – in the Irish higher education and research context. In particular, we also add to the growing body of work on this topic by integrating the perspectives of data stewards and data managers, whose role has been ignored or eliminated in the context of commercialization. We also draw on policy and practice documents from funders, higher education institutions, and other national and supranational bodies (such as the Organization of Economic Cooperation and Development, or the OECD) to provide the context in which open science and commercialisation of research are done.
Analytical Framework
We draw heavily on the work of Lattu and Cai (2022) who conducted interviews with research stakeholders in Finland and China to explore the tensions of university-industry partnerships. They frame their work in the context of Institutional logics that have been used in organizational studies to explore how individuals navigate complex institutional relations – and PPRP are one example of such a complex institutional system. Institutional logics encompass the norms, values, belief systems, histories, and material practices that underpin and constitute actions. In their work, institutional actors are generally found in their work in academic, industry, and government and intermediaries whose role is to facilitate collaborations across these sectors. The analysis of competing institutional logics forms the heart of their analyses.
Thornton and Ocasio (1999, pg. 804) provided a definition of institutional logics as ‘the socially constructed, historical patterns of material practices, assumptions, values, beliefs, and rules by which individuals produce and reproduce their material subsistence, organize time and space, and provide meaning to their social reality’. Logics are believed to provide guidelines on how to interpret social situations and compiling with them provides legitimacy and confirmation for organisations by their society (Thornton & Ocasio, 2008).
In academic research, conflict between the logic of open science and commerce may arise when universities pursue open access and where this conflicts with the pursuit of commercialization of research results. Researchers of institutional logics seek to understand the organizational responses to these tensions and this is at the heart of our paper. Furthermore, some of the professionals with the greatest interest and expertise in open science – the data stewards and data managers who work in higher education, funders, and other bodies - are not considered as part of the PPRP ecosystem in the literature. In this paper, we look at the competing institutional logics and the tensions inherent in them and also look at how data stewards and managers are conceptualized by these other actors and how their institutional logics play out.
Research Design
We draw on Irish and international policy documents from funding bodies, universities, and other organisations with relevant interests. Themes which were pursued in semi-structured interviews with researchers and research support staff. We did not pursue a systematic approach to recruitment but instead drew on convenience sampling for this study. We also conducted a survey of data stewards and others with similar roles. Because there is no standardization with respect to the titles of these roles, we disseminated our survey via a listserv of individuals working in data stewardship across Ireland. We received 19 responses which comprised both closed- and open-ended questions. Data were analysed based on Clarke and Braun’s concept of Thematic Analysis (2017) using Atlas.ti.
Findings
Interviewees and survey respondents cited lack of time, insufficient support for making decisions around when/if to make work open (or commercialise it), and potentially sharp distinctions between academic and commercial work, and lack of communication among stakeholders. Some data stewards cited downright hostility between themselves and the technology transfer offices at their institutions; researchers felt that they were not given clear pathways and guidance, especially with respect to commercialisation. The research team will expand upon the number and type of interviews and also delve further into policy analysis to learn more about open research and PPRP.
Bibliography
Clarke, V., & Braun, V. (2017). Thematic analysis. The journal of positive psychology, 12(3), 297-298.
Dalipi, F., Ferati, M., Kurti, A., & Kastrati, Z. (2022, June). Investigating the FAIRness of Science and Technology Open Data: A Focus in the Scandinavian Countries. In International Conference on Human-Computer Interaction (pp. 276-283). Cham: Springer International Publishing.
Lattu, A., & Cai, Y. (2023). Institutional logics in the open science practices of university–industry research collaboration. Science and Public Policy, 50(5), 905-916.
O'Mahony, S., & Bechky, B. A. (2008). Boundary organizations: Enabling collaboration among unexpected allies. Administrative science quarterly, 53(3), 422-459.
Perkmann, M., & Schildt, H. (2015). Open data partnerships between firms and universities: The role of boundary organizations. Research Policy, 44(5), 1133-1143.
Thornton, P. H., & Ocasio, W. (1999). Institutional logics and the historical contingency of power in organizations: Executive succession in the higher education publishing industry, 1958–1990. American journal of Sociology, 105(3), 801-843.
Thornton, P. H., & Ocasio, W. (2008). Institutional logics. The Sage handbook of organizational institutionalism, 840(2008), 99-128.
Academic patenting in the USA and Canada: changing patterns and comparisons with Europe
ABSTRACT. Academic patents are one of the most important means of technology transfer from science to industry. Technology transfer is in the focus of innovation research since many years. The reason is that technology transfer can be seen as means to increase the technological competitiveness of companies and of nations, but also as means to pay back the investment made by the so-called taxpayer into science. In other words, next to private returns to the commercializing company, public value is also expected to emerge from technology transfer.
The work presented here offers a reliable method to identify academic patents, i.e. patents invented by a researcher affiliated to a university plus patents filed by the university itself - at large scale for the US and Canada. A similar method was successfully implemented for 39 EPC member countries. The analyses of the so generated data show considerable differences in the ownership patterns of academic patents across countries, mainly reflecting the existing/missing regulation of ownership (e.g. Bayh-Dole). This paper will extend the existing method to the US. While it has been successfully implemented for Canada already, the implementation of the method for the US is pending. The core challenge for the US is the larger science community, leading to larger numbers of homonyms. In addition, for US researchers/inventors the distance between work and home addresses might be larger than in other countries, posing a challenge for the method that uses geographic distance as one means to disentangle the homonym problem. Next to the implementation of the method itself, validation needs to be undertaken as well.
The first research question is, if it possible to extend the existing methodology to the US at a reasonable quality (precision and recall) of the data. Second, if the methodology can be implemented successfully, we will analyse the trends of academic patenting in North America and compare the structures to selected countries in Europe.
One way of technology transfer might be based on licensing contracts. However, licensing contracts are private and usually not disclosed and therefore hard to identify or quantify. Other means or indications of technology transfer are, for example, contract research, joint publications, informal knowledge transfer, or spin-offs. Academic patents might be an outcome of joint research, of successful licensing or of ownership transfer. Academic patents are defined as patents filed by the university and/or invented by at least one person affiliated with the university and filed by another entity.
The USA was the first country to introduce a regulation - called Bayh-Dole act - that allows universities the (first) ownership and decision-making on inventions emerging from government-funded research. Identical or similar regulations have been introduced in several countries afterwards. For example, the professor's privilege was abolished in Germany in 2002 till then allowed a professor to file and own the patent rights emerging from inventions made by her. Since 2002, the university owns the invention and decides (first) on its use. Several other countries, for example France, Sweden or Italy (see Lissoni et al. 2009), have also implemented Bayh-Dole-Act-like regulations in the early 2000s, while Canada still has no such regulation implemented. The numbers of university-filed (owned) patents increased in most countries that have introduced such a regulation.
The methods underlying the data identification activities in this paper aim at the identification of the (complete) patent output of universities (academic patents). The challenge, however, is to identify university-invented patents as one part of academic patents. To do this, a matching procedure of author names from Elsevier's Scopus with inventor names from PATSTAT will be performed for the US. Next to missing inventors in Scopus (not all academics who file a patent might also publish papers in journals that are listed in Scopus), the biggest challenge of this procedure is the treatment of homonyms.
Our algorithm follows a rule-based approach that builds on a Levenshtein distance string matching algorithm of author/inventor names, with a matching score of 0.89 that was identified as an optimal level in a gold-standard dataset of 200 inventor-author linkages. In addition, we allow matches only if the patent and the publication are within a similar time window, i.e. the priority date of the patent should be in the same year as the publication or the previous year. Furthermore, we accept an author-inventor match only if the addresses are within a certain distance. For this purpose, we geocode both, patents and publications. As distances between home and work addresses of researchers in the US might be larger than in Europe, we need to develop an optimal distance that fits the US context. Hence, we will create another gold-standard dataset for the US. To further reduce homonyms (false positives), the patent and the publication are required to fall into similar technological areas, which we assign by a coarse-grained concordance of technology fields in patents and scientific fields in publications. The outcome of this procedure is a dataset of patents flagged as academic patents.
Once the dataset is established, we intend to analyse the trends of academic patenting in North America and compare them with the trends that we found in our study on Europe. To be able to analyse the applicant structure of university-invented patents, we resort to our PATSTAT-ORBIS link.
Consultancies, Problems in Research, Mentoring Practices, and Research Productivity: The Case of Academics in Dual-Disadvantaged Situation
ABSTRACT. Situated in the dual-disadvantaged position of being in a resource-constrained institution in a developing country, we conducted a pilot-study to examine how academics’ consultancies with commercial entities impact problems in research, mentoring practices, and research productivity. Our findings derive from analyzing original face-to-face survey data using bootstrap regression and principal component analyses. Three core problems in research emerged: management-, instrument-, and coordination-related. Instrument-related problems were mitigated by involvement in consultancies. Regarding mentoring practices, three emerged: socializing students with commercial entities, providing students with guidance and feedback, and helping students with job search. Consultancies were directly linked to the socialization of students to commercial entities, which included exposing them to consultancies, collaborations, and funding opportunities. Involvement in consultancies and volume of productivity were not directly linked. The socialization of students to commercial entities linked consultancies to productivity. Our results provide an insightful view of and generate hypotheses on how academics’ consultancies shape mentoring and problems in research. Contrary to claims that academics’ engagements with commercial entities are ‘malignant’ to science -- especially so in the context of resource-constrained institutions -- our pilot results indicate that such engagements do not translate to dismal outcomes, exacerbate research problems, or generate irregular mentoring practices.
Insights from the Origins of the Science of Science: Historical Implications for Contemporary Science Policy
ABSTRACT. The aim of this presentation is to explore the historical emergence of the science of science, specifically drawing from its development in Poland, and to demonstrate its relevance for shaping contemporary science policy. The talk will shed light on how historical lessons from the formative years of the science of science can inform current debates and approaches to science governance. This historical analysis serves not only as a testament to the contributions from peripheral scientific communities but also as a guide for modern frameworks seeking to balance practical and theoretical insights in science policy.
The emergence of science of science
Rapperswil Castle from the early 13th century located on a peninsula on Lake Zurich witnessed centuries of history before falling into disrepair. In 1870, it found a new lease on life when Polish émigré Władysław Ewaryst Plater leased it and transformed it into the Polish National Museum. Half a century later, plans were underway for Rapperswil Castle to become the home of the world’s first Institute of Science of Science, to be led by Maria and Stanisław Ossowski. Though this ambitious vision never materialized, it underscored the superior aspirations of Stanisław Michalski, the driving force behind this science-of-science endeavor.
Today, Michalski’s name might not resonate with many historians of science, even in Poland, let alone beyond its borders. Born in 1865, Michalski was a vital figure in the scientific movement that, in the early 20th century in Warsaw, led to the emergence of a new academic discipline: the science of science. He also served as the founding editor of the world’s first strictly science-of-science journal, Nauka Polska. Jej Potrzeby, Organizacja i Rozwój (en. Science and Letters in Poland: Their Needs, Organization, and Progress). This journal in 1935 published a cornerstone work for the new discipline, namely an article by Maria and Stanisław Ossowski. Their work laid out the first comprehensive program for this new discipline designed to enrich both science and society with its theoretical and practical insights.
Why did the science of science emerge specifically in Poland?
The shortest possible answer is this: a group of Polish scholars, due to objective circumstances, was primarily educated outside the borders of what was then a non-existent Poland on the map of Europe. They participated in international research and discussions on the status and role of science. In terms of understanding what science is, how it should be practiced, and its role, there was nothing particularly unique to explain the emergence and development of the science of science in Poland.
What was unique, however, at the turn of the 19th and 20th centuries, was the end of Poland’s partition into three parts in 1918 after 123 years of non-independence. This challenge of unifying the three partitions and understanding the potential role of science in this task created the historical conditions for proposing the science of science in Poland. Scientists in no other country, who also discussed science and its role, faced the same political, cultural, and societal task as Polish scientists in similar historical circumstances. However, it should be noted that science was perceived as a significant hope for technological and political development in many of the new states founded in the former imperial spaces of Central and Eastern Europe after the First World War.
Reintegrating these three separate regions, each with different administrative, legal, and educational systems, infrastructure, health system, and units of measurement into one cohesive state was an unprecedented challenge. These experiences equipped Polish scholars with a broad and comparative perspective on the role of science in society. They understood that science was not just a pursuit of knowledge but a crucial instrument for national integration and modernization.
This perspective was essential to the emergence of the science of science in Poland, emphasizing the need for a reflective and organized approach to scientific practice and policy. Thus, science of science as metadiscipline was born out of the necessity to integrate disparate scientific traditions and leverage science as a tool for national development and identity reconstruction.
Science as a policy tool for national integration and modernization
Since the publication of the Ossowskis’ work, much has been written about science studies and the science of science itself. When re-reading their “Science of Science,” it is crucial to remember that their approach—treating science as a social and cultural phenomenon—was far from obvious at the time. In fact, it was quite revolutionary during the 1920s and 1930s.
The Ossowskis emphasized viewing science as a collective human endeavor, moving away from the traditional focus on isolated individual achievements. They were pioneers in advocating for an interdisciplinary approach to science studies, recognizing that a comprehensive understanding of science necessitates integrating insights from philosophy, sociology, psychology, and the practical organization of scientific activity. This integration, they argued, should be collaboratively undertaken by the scientific community. Today, their interdisciplinary vision is increasingly relevant, as modern science studies and scientometrics employ diverse methodologies to tackle complex questions about the nature and function of scientific work.
A particularly forward-thinking aspect of the Ossowskis’ program was their focus on the practical and organizational dimensions of science. They argued that effective scientific practice and policy require systematic study and understanding, analogous to the planning and analysis required in industrial production. In today’s context, where research evaluation, science policy, and the management of scientific institutions are central concerns, their emphasis on practical applications remains highly applicable. The Ossowskis anticipated many of the challenges that modern science governance faces today, making their insights invaluable for contemporary discussions on how to manage and support scientific research effectively.
Moreover, the Ossowskis emphasized that the way we conceptualize science directly influences the training of future generations of scientists and how they perceive the role of science in society. Revisiting their program can inspire new ways of thinking about how we study and evaluate science, serving as a reminder that our current approaches are built on a rich history of reflection and debate.
Unpacking social impact: Quantifying scholarly and social activities in humanities and social sciences in Japan
ABSTRACT. Introduction
The “science of science” (SciSci) has established itself as an emerging interdisciplinary academic field; related research uses big data and computational technologies to examine the processes and mechanisms by which scientific knowledge is newly created, shared, and later institutionalized through a complex, self-organizing, and evolving network of scholars, projects, papers, and ideas (Fortunato et al., 2018). In tandem with established academic fields such as the history of science, philosophy of science, sociology of science, scientometrics, library and information science, and science for policy, SciSci has deepened our understanding of how science succeeds by quantitatively examining the process by which various scientific agents interact across diverse geographic and temporal scales (Wang & Barabási, 2021).
SciSci’s progress has offered us evidence-based findings that help promote science, technology, and innovation policy. However, this only applies to the science of “hard science”; research on the science of “soft science” (i.e., the humanities and social sciences) is far less extensive. Thus, we know little about the processes and underlying mechanisms by which scholars in the humanities and social sciences share their ideas, collaborate, write papers and books, and engage in social activities.
To fill this research gap, we first need to capture how scholarly and social activities in the humanities and social sciences may have a social impact. Shedding more light on the science of soft science and its impact on society could increase our understanding of how the creation and adoption of new ideas, knowledge, and technologies evolve over time alongside individual values and psychologies, societal values, business models, political relations, legal and policy frameworks, and regulatory regimes.
This paper aims to empirically examine this social impact in terms of direct and indirect effects on science, technology, and innovation policy. The first task is to identify different types of scholars according to their professional identities among disciplines by conducting qualitative interviews with scholars about their professional identities. The second task is to examine differences among the various humanities and social sciences by quantifying scholarly and social activities and their academic and non-academic outputs.
Sample and Methods
To empirically examine the characteristics of scholarly and social activities among humanities and social sciences scholars, we first conducted a qualitative study (Study 1) and then conducted a quantitative study (Study 2). In Study 1, we conducted semi-structured interviews with 78 scholars randomly selected from 41 of the 69 humanities and social sciences subfields defined by the Ministry of Culture, Sports and Education in Japan. The interviews were conducted from December 2023 to July 2024. Interviews lasted on average from 60 to 90 minutes; in total there were 84 hours and 19 minutes of interviews. Every interview was audio-recorded, transcribed, and coded to identify issues related to the participants’ research activities, environment, research outcomes, research evaluations, and subjective relationship to society.
After coding qualitative data for Study 1 based on the grounded theory approach, Study 2 was conducted to identify similarities and differences among scholars by types of organization, main fields, and sub-fields. Study 2 was based on a bibliometric examination which quantified the numbers and frequencies of papers, books, academic presentations, reports, and various kinds of academic and non-academic activities for 95753 scholars. We utilized a national-level Internet database service called Researchmap, run by the Japan Science and Technology Agency (Arai & Masukawa, 2010). Researchmap is an Internet database service that collects information on researchers, including their career histories and lists of papers; it includes data relating to Japanese researchers and foreign researchers affiliated with Japanese research institutions (including national, public, and private universities; graduate universities; junior colleges; technical colleges; and research institutions).
We merged individual activities and their outcome by year, types of affiliated organizations, and 69 subfields consisting of 11 main fields (psychology, political science, geography and anthropology, economics and business administration, social and economic agriculture, education, literature and linguistics, history and archaeology, philosophy and art, sociology, and law).
This research represents the first attempt to comprehensively quantify research activities and outcomes of scholars in humanities and social sciences in Japan. These data, encompassing peer-reviewed articles and broader research activities, including participation in government councils, engagement in mass and social media, and involvement in archaeological excavations, offer key insights.
Empirical Findings
The empirical findings of this paper are summarized in the following two points. First, we identified similarities and differences among humanities and social sciences disciplines regarding research activities, research output, and social engagements. International activities and publications in international refereed journals were more common among psychology and economics scholars. In contrast, publishing in non-refereed publications and Japanese-language books, as well as conducting local activities, were more common among literature, sociology, and law scholars.
Second, the degree of social engagement differed among scholars, though not according to their disciplines; this suggests differences among scholars in terms of their socio-cognitive definitions of their professions. That is, such differences appear to depend not only on the universal nature of academic professions but also on historically determined institutionalized divisions of labor. Although our findings have some limitations, they can contribute to research examining the notion of a National Innovation System.
References
Arai, N., Masukawa, R. (2010) Researchmap opening the door to the world of Science 2.0, Proceedings of the 13th IASTED International Conference on Computers and Advanced Technology in Education, CATE 2010, pp.166-171.
Fortunato S., Bergstrom, C.T., Börner K., Evans, J.A., Helbing, D., Milojević, S., Petersen, A.M., Radicchi, F., Sinatra, R., Uzzi, B., Vespignani, A., Waltman, L., Wang, D., Barabási, A.L. (2018) Science of science, Science, 359 (6379).
Wang D, Barabási A-L. (2021) The Science of Science. Cambridge University Press.
Are Societal Promises in Science and Technology Substantiated? A Study of Value Expressions in Patents
ABSTRACT. This study investigates whether value expressions (VEs) in patent documents - narrative statements describing societal or commercial problems, solutions, and promises - reflect the technological orientation (i.e., the potential to address certain commercial or societal problems based on the invention's objective technological features), or primarily serve as rhetorical devices. The research focuses on patents in artificial intelligence and nanotechnology, two fields with significant potential for societal impact (Roco, 2023; OECD, 2024; Goos and Savona, 2024).
Using both generative and discriminative large language models, we analyze 175,730 U.S. patents filed between 2005 and 2023, categorizing statements into three types: public value expressions (PVEs) related to societal impact, private value expressions (PRIVEs) related to commercial value, and combined expressions (PVE-PRIVEs) covering both aspects. Specifically, we implement a method based on Pelaez et al. (2024), which involves using a structural prompt with GPT-4 to label 20,000 samples. These labeled samples then serve as a training set for fine-tuning RoBERTa Large, enabling it to predict classifications across a dataset of 7.1 million sentences. This approach generates key variables at the patent level, including whether a patent contains at least one of these expressions ("occurrence") and the proportion of text devoted to these expressions ("density").
We correlate these expressions with a patent's technological orientation, which includes two broad categories: socially oriented or otherwise. A socially oriented patent is one that, based on its objective technological features, is better positioned to address societal issues. This variable is operationalized through mapping to UN Sustainable Development Goals (SDGs) based on technological classification provided by LexisNexis Intellectual Property Solutions.
Our findings reveal a significant alignment between narrative promises and technological focus. PVEs show a positive association with social orientation - patents mapped to SDGs based on their core technical attributes. Conversely, PRIVEs exhibit a negative correlation. Most notably, PVE-PRIVEs demonstrate the strongest positive association with social orientation, suggesting that patents articulating both public and private values may be best positioned to address societal challenges while maintaining commercial viability. This aligns with Porter and Kramer's (2011) concept of shared value creation.
These results challenge the notion that VEs in patents are merely rhetorical tools, contrasting with other value-based statements in science, technology and innovation (STI) that have been criticized for lack of enforceability and potential for "ethics-washing" (Munn, 2023). The correlation between PVEs and social orientation suggests these expressions may reflect or indicate an invention's genuine potential for societal impact.
The research contributes to discussions about value-based statements in STI, including soft law tools like guidelines and standards to govern emerging technologies (Schiff et al., 2020), broader impact statements in research funding (Bozeman and Youtie, 2017), and Ethical, Legal, and Social Implications (ELSI) within technology initiatives (Fisher, 2019). We propose that VEs may play an important role in responsible innovation frameworks and anticipatory governance by articulating potential societal impacts ex-ante (Guston, 2014).
This study responds to recent calls to develop "new quantitative methods to identify the public value of patents" and "identify the societal value or harm of intellectual property rights in a systematic way" (Castaldi, 2024). By demonstrating meaningful alignment between narrative promises and technological orientation in patents, we contribute to understanding how value-based statements in STI may substantively reflect and potentially influence the development of socially beneficial technologies.
References
Bozeman, B., & Youtie, J. (2017). Socio-economic impacts and public value of government-funded research: Lessons from four US National Science Foundation initiatives. Research Policy, 46(8), 1387-1398.
Castaldi, C., Giuliani, E., Kyle, M., & Nuvolari, A. (2024). Are intellectual property rights working for society?. Research Policy, 53(2), 104936.
Fisher, E. (2019). Governing with ambivalence: The tentative origins of socio-technical integration. Research Policy, 48(5), 1138-1149.
Goos, M., & Savona, M. (2024). The governance of artificial intelligence: Harnessing opportunities and mitigating challenges. Research Policy, 53(3), 104928.
Guston, D. H. (2014). Understanding 'anticipatory governance'. Social Studies of Science, 44(2), 218-242.
Munn, L. (2023). The uselessness of AI ethics. AI and Ethics, 3(3), 869-877.
OECD (2024). OECD Digital Economy Outlook 2024 (Volume 1): Embracing the Technology Frontier. OECD Publishing, Paris. https://doi.org/10.1787/a1689dc5-en
Pelaez, S., Verma, G., Ribeiro, B., & Shapira, P. (2024). Large-scale text analysis using generative language models: A case study in discovering public value expressions in AI patents. Quantitative Science Studies, 5(1), 153-169.
Porter, M. E., & Kramer, M. R. (2011). The big idea: Creating shared value. Harvard Business Review, 89(1-2), 62-77.
Roco, M. C. (2023). National Nanotechnology Initiative at 20 years: enabling new horizons. Journal of Nanoparticle Research, 25(10), 197.
Schiff, D., Biddle, J., Borenstein, J., & Laas, K. (2020). What's next for AI ethics, policy, and governance? A global overview. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (pp. 153-158).
Disciplinary and temporal trends of higher rates of policy document citation of interdisciplinary research
ABSTRACT. INTRODUCTION
I examine the effect of interdisciplinarity on attention to research by policy makers. Publications categorized by multiple fields of research have much higher rates of citation in policy documents. This study considers the policymaking landscape in the US and EU and the publications cited in governmental policy documents, comparing alpha-beta collaborative research with single-field research. In addition to this analysis, in order to determine whether funding mechanisms play a role in encouraging policy-relevant interdisciplinary research, two specific initiatives (the ERC Synergy Grants and the NSF INSPIRE mechanism) are evaluated, comparing the policy uptake of publications arising from research funded by these grants to that of other similarly-sized, single-field research projects supported by the ERC and NSF. Patterns over time and differences between fields of research are each considered.
BACKGROUND
In previous work (Campaign for Social Science 2023), we have found that the uptake of research by UK governmental policymaking organizations was proportionally higher for those publications which cross the STEM/Social Sciences divide (alpha-beta research). Specht & Crowston (2022) looked at interdisciplinarity and considered the role of multiple qualitative favors, as well as assessing impact by comparing the quantity of research output and the sum of scientific citations. I have drawn on Taylor (2023) for overall baselines for normal citation timelines for research output in policy documents.
DATA
This analysis is produced using the Dimensions dataset, which consists of tables of metadata about (among other data types) nearly 150 million publications, over 7 million grants, and 2.5 million policy documents. The relationships between these tables are provided via linking fields (supporting_grant_ids, (citing) publications, etc.). The Dimensions dataset is further enriched with machine learning classification, organization metadata, and funder-provided grant details, including the fields of research of publications, the type of policymaking organization, and the grant program for each awarded grant. The connection between 7.4 million grants and their over 12 million resulting publications have been established by looking at the grants mentioned in the text of the publications. Citations of publications in policy documents are identified by using persistent identifiers (DOIs, PubMedIDs, etc.) and links (handles and URLs) to publications in the policy document text. The Dimensions dataset has the advantage of being freely available for scientometric research projects, which means that this study can be reproduced and interrogated, and future patterns of policy document citation can be investigated in comparison to this work.
METHODS
The comprehensive nature of the dataset and the capabilities of Google's BigQuery make it possible to do a descriptive analysis, making sampling of the dataset unnecessary. The study population includes, in the first case, global research output categorized by number of associated fields of research.
In order to establish whether the interdisciplinarity is a result of collaboration or design, a disciplinary profile is calculated for the co-authors of these publications: primarily STEM, primarily social science, or primarily interdisciplinary. Trends observed in the temporal analysis are compared across research with various collaboration patterns.
The distribution of policy attention to research over time (from time of publication to time of policy attention) shows a peak in first mentions of research by policy documents in the second year after publication, with the number of new first mentions dropping below the frequency of the first year only after year 7. This makes estimating new trends in policymaking a long-term affair. The first temporal analysis therefore considers the impact over time of research published between 2015-2017, and the second compares the results of the first two years of policy citations of that research with the first two years of policy citations for research published in 2022.
DELINEATION OF THE STUDY POPULATION
The first corpus of publications is the 114 million publications categorized by field of research in the Dimensions dataset. The rates of policy citation for these, by number of fields and by interdisciplinarity of authors, are compared over time. The second corpus of publications includes those published between 2015-2017 and categorized by field of research. This consists of just over 11 million publications. The third corpus of publications consists of documents published in 2022 and categorized by field of research, of which there are 5,686,668 publications. Finally, I consider publications arising from the NSF- and ERC-supported interdisciplinary grants and their resulting publications. Of 193 grants recorded as belonging to the INSPIRE or Synergy programs in Dimensions, 173 have associated resulting publications. Of those, 127 publications resulting from 27 grants have been cited in 366 policy documents.
CONSEQUENCES FOR RESEARCH AND FUNDING POLICY
The results of this analysis have shown that policy documents cite interdisciplinary research at a much higher rate. The findings provide evidence for the importance of interdisciplinary co-operation from the point of research design through co-authorship. This research suggests that policies that encourage cross-disciplinary collaboration have a positive influence on the production of policy-relevant research. By providing data to support the effect of such policies, this research should empower funding agencies to develop more impactful mechanisms to support policy-relevant research.
CODE AVAILABILITY AND DATA ACCESS
The code used for this study will be made publicly available on Figshare. All of the data used are accessible with a Dimensions license or scientometric access to Dimensions.
REFERENCES
Campaign for Social Science Reimagining the Recipe for Research & Innovation: The Secret Sauce of Social Science. First Edition. SAGE Publications Ltd, 2024. https://doi.org/10.4135/9781529681345.
Specht, A. & Crowston, K. (2022) Interdisciplinary collaboration from diverse science teams can produce significant outcomes. PLoS ONE 17(11): e0278043. https://doi.org/10.1371/journal.pone.0278043
Taylor, M. (2023) Slow, slow, quick, quick, slow: five altmetric sources observed over a decade show evolving trends, by research age, attention source maturity and open access status. Scientometrics 128, 2175–2200. https://doi.org/10.1007/s11192-023-04653-1
Funding Disparities in Science: Analyzing the Influence of Gender, Field, and Seniority in Brazilian Peer Review
ABSTRACT. The recent expansion of discussions on the need for more transparent practices in prioritizing, selecting, and funding research includes, among other factors, a closer examination of conventional evaluation procedures in science, particularly peer review. In this context, debates frequently arise regarding the strengths and limitations of this traditional method, which, despite being deeply institutionalized within scientific practice, remains susceptible to various biases and inaccuracies. Although discussions on this topic have intensified in recent years, empirical and exploratory research on peer review, especially in scientific journals or funding agencies, remains limited. This gap is largely attributed to the scarcity of available data, particularly in developing countries.
This study, adopting an empirical and exploratory approach, aims to analyze the peer review process in project selection conducted by the São Paulo Research Foundation (FAPESP), a major research funding agency in Brazil. Specifically, it investigates the profiles of researchers and reviewers and their influence in selection processes.
The analysis encompasses 37,423 research grant applications submitted to FAPESP between 2000 and 2017, covering both approved and rejected proposals. The database, containing information on the application processes, proponents, reviewers, and decision outcomes, was provided by FAPESP and complemented with publication data from CV Lattes, a public platform hosting the academic résumés of Brazilian researchers.
Two complementary methodological approaches were employed for data analysis. The first approach applied a Baeyesian logistic regression to model the probability of grant approval in the programs studied, focusing on understanding variations in the distribution of profiles between approved researchers and those who submitted proposals. This analysis considered aspects such as field of knowledge, gender, seniority, and prior experience in obtaining research grants from FAPESP. To enhance the accuracy of the analysis, control variables were included: the field of knowledge of the proposal, the submission year, and the year of PhD completion of the proposer. These variables aimed to isolate the effects of potential confounders, ensuring that the relationship observed between proposal characteristics (and proponents) and funding decisions was accurately interpreted.
This analysis allowed for the identification of funding patterns that may suggest the presence of systematic biases or discrepancies in resource distribution—a particularly relevant issue in the context of promoting equity and diversity in science.
Approval rates in the analyzed programs ranged from 40% to 60%, with higher rates in the fields of biological sciences, exact sciences, humanities, engineering, and linguistics, and lower rates in agrarian, health, applied social sciences, and interdisciplinary fields. Interdisciplinary research, although categorized within traditional knowledge areas, generally had slightly lower approval rates than non-interdisciplinary research within the same areas, except in agrarian and health sciences.
Regarding gender, female applicants generally had lower approval rates than male applicants, except in Applied Social Sciences, where women had a higher success rate. This gender gap tended to narrow after adjusting for the year of proposal submission and the year of PhD completion.
Additionally, the proximity to the year of PhD completion was found to negatively impact funding approval chances. Each additional year of academic experience (measured from the year of PhD completion) increased the likelihood of proposal approval by 1%, highlighting the importance of seniority in funding decisions.
The study also investigated the "Matthew Effect" in submitted proposals, examining whether those who had previously received funding were more likely to secure new grants. The findings suggest that applicants who had received FAPESP grants during the study period had an 18% higher approval rate than those without prior funding approvals.
The second methodological approach utilized XGBoost, a gradient boosting machine (GBM) algorithm, to estimate classification probabilities, similar to the estimation of propensity scores. This analysis added reviewer profiles and proponents' scholarly output to the initial model, examining how differences in field of knowledge, gender, and seniority between reviewers and proposers might influence funding decisions. Additionally, the role of scholarly output, alongside other variables, was evaluated in relation to funding approval.
In terms of influential factors, the field of knowledge emerged as the most critical determinant of funding approval, followed by the quality (measured by the SCImago Journal Rank, SJR) and quantity of published papers, seniority differences between reviewers and applicants, and the applicant’s PhD completion year. Gender and the match between the applicant's and reviewer’s fields were less influential.
The relationship between these factors also revealed notable patterns. Approval rates were higher for researchers with greater scholarly output, both in terms of quantity and quality, and for more senior researchers, though the strength of these associations varied by field. For instance, in applied social sciences, the link between grant approval and publications was less pronounced than in biological and exact sciences. Conversely, seniority was a more significant factor for approval in fields like humanities and arts than in biological and exact sciences.
Finally, a modest effect of the difference in academic age (measured from the PhD completion year) between reviewers and applicants was observed. Larger age gaps (with reviewers being more senior) correlated with lower approval rates, with distinct patterns across knowledge areas. Across these findings, the influence of applicant and reviewer gender, as well as their combinations, was minimal.
The analysis highlights the existence of modest biases in the review processes of the studied funding agency, echoing both longstanding and recent criticisms of peer review.
This study's findings contribute to broader discussions on research funding and evaluation practices, emphasizing the need for inclusive and diverse strategies to foster a more representative science capable of addressing current research challenges, especially in developing countries like Brazil. Such strategies are essential not only to promote fairness and equity within the scientific community but also to support a broader spectrum of innovative, high-quality research that responds to emerging social and scientific needs.
Research and Policy: mapping the literature across labels and disciplines
ABSTRACT. Introduction and research questions
Scientific knowledge offers essential support for policymaking, serving as a valuable source of robust and reliable evidence to inform decisions. Research can be particularly useful for policymakers in navigating complex societal, environmental and economic challenges, such as the climate emergency, inequality, and public health (Capasso et al, 2019; Holtz et al, 2020; Viola et al, 2021). Despite its potential, accessing, and effectively using research remains a persistent challenge.
Considerable scholarly attention has been devoted to understanding the conditions, practices, and processes that facilitate the use of research-based knowledge in policy (Oliver et al, 2014; Cash et al, 2003; Bozeman and Sarewitz, 2005; Molas-Gallart and Tang, 2011; van der Arend, 2014; Gluckman and Wilsdon, 2016; Donovan 2011; Penfield et al. 2013; Thomas et al. 2020; de Rijcke et al. 2016; Watermeyer 2016). This focus spans multiple disciplines, with specialized journals such as Research Policy, Evidence & Policy, Environmental Science and Policy, Policy and Society, Health Research Policy and Systems, showcasing research use in and impact on policy as a core theme. Articles on the use of research in policymaking appear in high-level general journals such as Nature and Palgrave Communications (Schleussner et al., 2016; Donnelly et al., 2018; Kenny et al., 2017; Duncan, 2020).
There is a consistent interest from the research community in improving the uptake of research in policy. However, a byproduct of this sustained engagement from across fields and disciplines is a fragmented research landscape. Studies on research use, uptake, and policy impact emerge from diverse disciplines, each examining its contribution to policymaking, resulting in a wide-ranging, multidisciplinary body of work on the topic. It ranges from impact assessment into 'research utilization' into the much broader political science literature on the relationship between science and policy into much more applied studies on evidence-informed healthcare, as well as a body of literature on technology assessment and deploying research to address climate change and other environmental challenges.
In this study, we aim to understand this rich, but fragmented research landscape by identifying the key contributions and their intellectual foundations. We answer the following questions: how do different fields and disciplines approach research use in policy? What are the major theoretical and conceptual frameworks in the different niches of this thematic landscape? In other words, this study traces the use of research in informing and shaping policy decisions and changes.
We draw on the established methods for the analysis of the intellectual structure of research topics and fields: a combination of co-citation analysis and bibliographic coupling.
Method and Approach
This paper uses a keyword-based approach to identify relevant contributions across fields and disciplines that discuss the use and application of research in policy. Although dedicated journals exist that include research use and impact in their scope, our interest is in capturing broad discussions across domains.
As the first step, we developed a pilot study to test the approach. At the time of submission, the original approach was in the process of modification. Below, we outline the key steps and findings from the pilot study, noting the steps currently taken to improve the quality of the analysis.
Dataset Construction
This study was conducted as a part of a large-scale research project focusing on the impact of research, including a strand focusing on the role of research users for policy. Several literature reviews were conducted by the research team as a part of this work, which also highlighted the need for a more organised understanding of the literature landscape.
The keyword-based query for the pilot study was developed by the research team on the basis of the literature reviews (Edler et al., 2020; Karaulova and Edler, 2024; Edler et al., in review). It can be accessed in Table 1. The query was run in the Web of Science database in 2019 using the “topic” field. The search identified over 4,000 results, which were analysed. The research team was able to meaningfully interpret the results and made the decision to proceed with the analysis.
Table 1 Search Query
((research OR knowledge) AND (translation OR utilization)) OR
(("evidence synthesis" OR "evidence review" OR "evidence assessment") AND policy*) OR
((evidence OR research) AND (based OR informed) AND policy*) OR
((evidence OR research OR scien*) AND policy*) OR
("research impact" AND policy*) OR
("impact of" AND (research OR science)) OR
((science OR knowledge OR research) AND "into policy") OR
(("public value mapping" OR "contribution analysis" OR "productive interactions" OR ASIRPA) AND policy*)
The search query will be enriched by checking it against a dataset built as a part of a systematic review of the literature on research use in public sector organisations, including policymaking and healthcare settings.
The analysis will help understand the research landscape, how the different literatures are connected and whether they rely on the common or different knowledge bases. To achieve this, co-citation analysis and bibliographic coupling will be conducted.
Bibliographic coupling links reflect thematic similarities between publications based on the extent to which their bibliographies overlap. By looking at the bibliographic coupling map, we can examine cognitive proximities among the sources in the dataset.
Preliminary results
Despite our initial impression of a fragmented landscape, the literature discussing the relationship between research and policy clusters around key papers providing the key theoretical concepts and constructs, as revealed by the results of bibliographic coupling.
On the other hand, the results of the co-citation analysis suggest that beyond these shared foundational theories, the discussions around research use in policy are field- and discipline specific, suggesting that researchers engage in discipline-bound discussions, but will not necessarily be aware of the work being conducted on research use in policy in other research fields. The results contain many empirical papers that examine attitudes of scientists and policymakers, knowledge transfer strategies and barriers. These papers have overlapping findings, but do not necessarily cite each other. Although there is value in field-specific discussions, the lack of cross-field awareness of research progress may lead to double work and parallel discoveries, as well as to miss out on learning.
Changes over time in the leaky pipeline: are gender differences decreasing?
ABSTRACT. Research question:
Gender bias in science has been extensively studied, and careers are a good example. Quite some research has focused on gender differences in becoming full professor, but other aspects of the academic career are less researched, such as gender differences in leaving academia (‘the leaky pipeline’ as this is often called). Here we focus on the question whether the gender difference in leaving academia has changed over time.
Data:
We use two cohorts of PhD students from the same university, in order to have as little as possible variation between the two cohorts: The first cohort consists of all PhD students who received their degree between 2000 and 2006 (N=960), and we follow their career in the first seven years after graduation. The second cohort consists of all PhD students who received the degree between 2010 and 2014 (N=1000) and are also observed over a seven years’ period.
As far as science is a merit driven system, one would expect that academic performance plays an important role in career advancement and in ending the academic career. However, performance has various dimensions, which may play a different role in different phases of the career. We assume that in the early career, research performance is the most important factor to remain in the system. As indicators for academic performance, we use bibliometric data – even when these are covering performance at best partly – are for the time being these are the best available. We excluded the fields where journal articles are not the dominant medium. Ignoring performance variables makes it impossible to distinguish gender differences from gender disadvantages or gender bias. Recent career studies therefore tend to include merit variables and mostly bibliometric data are used to measure research achievements. We include also variables measuring prestigious grants, and other prestigious signs of recognition, such as the cum laude award for the PhD thesis.
Apart from merit, also other variables can be expected to influence the career, such as (i) personal characteristics like career preferences, which may be influenced by e.g. self-perception or gender stereotypes, (ii) family obligations which may lead to less time to invest in academic performance and to career breaks, and (iii) contextual factors such as the discipline, the reputation of the organization, and the PhD year (with the growth of the number of PhD students, a larger share of them may leave academia).
The following data are collected about these early career researchers: (i) bibliometric performance variables, (ii) acquired prestigious grants, (iii) PhD with a honors recognition, (iv) the year of the PhD, (v) the faculty, (vi) research field, and (vii) career breaks as indicator for family obligations.
Methods:
A Kaplan-Meier analysis will show whether women indeed leave academia more often and earlier than men do. An event-history analysis will be deployed to predict leaving the academic system, using the above-mentioned covariates. If gender has an effect on leaving academia after controlling for performance and other relevant covariates, one may conclude that the leaky pipeline is biased.
Both analyses are done for the two cohorts, and then a comparison between the two cohorts shows whether the problem of the leaky pipeline is declining or not.
Finally, for both cohorts we will try to create matched pairs, to have an experimental test of the effect of gender on the probability to leave academia.
Results:
The analysis of the first cohort has been done, resulting in a statistically significant larger share of women – compared to men - is leaving academia. When including the covariates, gender does have a significant effect on leaving academia (women do it more often). The covariates have the expected effects: the performance variables correlate positively with remaining in the system, and the more recent PhD receivers in the first cohort have a higher probability to leave academia, suggesting that competition increases over time. The analysis of the second wave and a comparison with the first wave leads to the following findings:
(i) In both the first cohort (2000-2005) and the second (2010-2014), men are leaving academia less frequently than women do. For example, in cohort 1, four years after the PhD, about 92% of the male sample is still publishing, whereas that only counts for about 84% of the women. For the second cohort the corresponding numbers are 89% and 80%.
(ii) In the second cohort the pipeline leaks more than in the first cohort and this holds for women and men. With the increase of the number of PhD recipients (in cohort 1 about 75 per year, in cohort 2 about 110 per year), the retention rates have gone down.
(iii) In the first cohort the gender difference increases stronger in the first cohort, and in the second cohort it is the other way around. So the early gender difference in retention has somewhat decreased, but in the later years the difference increases faster in the second cohort.
(iv) Over the first seven years, the early cohort shows that the retention of men is 10% higher than of women, whereas in the later cohort the difference is 15%. So the gender difference increases over time, despite policies aiming at gender equality
Conclusion:
Gender bias (in favor of men) in leaving academia seems to increase
Policy relevance:
According to many observers, the working environment within universities has deteriorated, and the competition has intensified, making the universities a less attractive place to work and for a career. Women would suffer from this more than men do, and that may lead to women more than men leaving the university. This study is one way of investigating this problem: are women indeed increasingly leaving academia, and stronger than men? Of course, follow up research has to go deeper into the possible causes of the leaky pipeline, such as performance differences, different career preferences, or gender bias. An analysis of the (changing) patterns is a first necessary step.
Who’s Keeping Track? A Framework for Equity, Diversity and Inclusion Accountability in Funding Agencies
ABSTRACT. Fighting inequality in the research ecosystem has become an increasingly prominent topic of discussion among scientists, universities, editorial bodies, and research institutions. The various inequalities faced by scientists significantly impact their activities, career trajectories, and workforce development. Particular attention should be given to the crucial role of funding agencies (FAs) in addressing inequalities in the scientific environment. As key players in the research ecosystem, FAs possess the power to either drive institutional change or reinforce, perpetuate, and even create new forms of inequality.
Although there is a concern on the part of these institutions to promote a diverse and inclusive environment, it is still a challenge to: i) identify the need for interventions and categorize them; ii) determine their efficacy and effectiveness; and iii) identify what characterizes the institutional capacity of an organization to determine why certain initiatives are effective and why some of them fail in promoting Equity, Diversity and Inclusion (EDI) in the research environment.
This study developed an original framework to map the range of EDI activities across various contexts and identity characteristics of FAs. It also aims to examine the institutional capacity of FAs to effectively implement EDI initiatives. The guiding research question is: How are EDI-related initiatives being institutionalized by FAs?
We conducted a literature review on the topics of EDI data and metrics to provide an updated perspective on how this issue is being addressed in recent research. Based on the review and benchmarking of previous studies, we developed seven categories of analysis to evaluate FAs institutional capacity to address inequities in science. Our preliminary results draw on secondary data from the selected FAs, including an analysis of their recent strategic plans, gender-related reports, and initiatives addressing EDI-related elements. The next step involves conducting interviews to collect primary data. We aim to compare the initiatives, common approaches, and innovative activities of the selected funding agencies.
Methodology
The research aims to identify initiatives that incorporate elements of EDI within research FAs. To achieve this, a framework was developed to collect secondary data from FAs, utilizing official documents such as strategic plans, annual reports, EDI-related action plans, and statements, as well as information available on official websites.
The first step of the methodological approach involved conducting a benchmarking and literature review to create categories for EDI-focused initiatives. These categories will subsequently be used to measure the institutional capacity of the analyzed FAs. The data sources used for this initial stage included scientific articles and reports that address the issue of inequality in science and on the collection and monitoring of diversity data.
To measure the institutional capacities of organizations to develop and implement effective EDI strategies and interventions, we investigated the following aspects and classified them into implemented practice, being implemented, and not available information. The seven categories, as well as the capabilities and initiatives evaluated, are:
i) To mention EDI in official documents
ii) Axes of diversity (gender, race, ethnicity, socio-economic, disabilities)
iii) To have dedicated EDI departments, teams, or other sorts of institutional areas
iv) Operationalization (e.g.: to have policy or institutional guidelines on EDI directed to the FAs' staff, reviewers and grantees; to have specific calls for underrepresented groups aimed at promoting EDI…)
v) To have internal training on EDI concepts, practices and policies for staff, reviewers, applicants and grantees
vi) Data collection of EDI of applicants, grantees, reviewers, and decision boards
vii) To evaluate and disseminate (to monitor and measure progress systematically of EDI initiatives; to make aggregated data publicly available; to communicate to the scientific Community and to the general public)
We consider all categories at the same level of relevance. Therefore, we assign equal weight to each category in the institutional capacity assessment, with each category receiving a maximum score of 10 points.
The following step is to apply this framework to selected Funding Agencies. Our study considers the application of this framework with two national FAs in Brazil, the Brazilian National Council for Scientific and Technological Development (CNPq) and the Coordination of Superior Level Staff Improvement (Capes); the National Council of State Foundations for Research Support, which currently brings together 27 FAs in Brazil and to a private FA called Instituto Serrapilheira.
Preliminary findings
This study is a work in progress, and we present here only preliminary findings based on secondary data from the analyzed funding agencies FAs. Despite the growing attention to EDI, there appears to be a predominant focus on gender-related initiatives, as exemplified by programs from both CNPq and Capes. In contrast, an intersectional approach that considers additional diversity dimensions, such as race, ethnicity, and disabilities, is more evident in activities promoted by the Instituto Serrapilheira. The use of specific calls targeting underrepresented groups to promote EDI is more common among agencies than the inclusion of EDI criteria in general calls.
Another important point to highlight is the issue of data availability. The decision not to communicate or demonstrate a specific program or initiative, or the lack of clear information about a strategic plan, for example, may be interpreted as a lack of maturity concerning the theme of combating inequality, or can indicate that the implementation of EDI can face more institutional obstacles and advance in a slower path.
Instances of this nature were observed in The São Paulo Research Foundation (FAPESP), often leading to a need for more available information and reliance on news reports from the agencies rather than official documents published by them. The absence of readily available information or institutionalized documents, in some way facilitated the identification of areas and practices resistant to change. This should be further investigated and confirmed with the gathering of primary data through interviews and questionnaires with the selected FAs.
Investigating how FAs, a core element of the research system, are addressing this issue can be an important starting point to assess if real change is actually taking place.
Transition from Natural Gas to Hydrogen: Roles of Incumbent Regime Actors Towards Sustainability
ABSTRACT. Background:
The accelerating impacts of climate change demand a rapid and sustainable transition from fossil-fuel-based energy systems to renewable alternatives. In this context, hydrogen gas is gaining a lot of attention, and South Korea has shown a strong commitment to hydrogen, pursuing various policy initiatives and R&D efforts from an early stage. For instance, the South Korean government announced national energy strategies centered on hydrogen energy in 2005 and 2019, and these strategies reflect a commitment to increasing hydrogen use across society, not just in fuel cells (Kim et al. 2024). However, contrary to traditional views that start-ups primarily drive energy transitions, public fossil fuel enterprises, based in natural gas, are attempting to lead this transition in Korea. Korea Gas Corporation has set a 2030 vision as “Everywhere Green Life, H2 KOGAS,” and similar agencies are advancing hydrogen safety standards and hydrogen plant technologies. This study situates this case within the context of incumbent-led sustainable energy transitions, using the Multi-Level Perspective (MLP) framework. MLP studies have argued that innovations develop within niches driven by new entrants (Kemp et al. 1998; Smith and Raven 2012). Although a growing body of research examines incumbent actors' roles, the mechanisms remain underexplored (Berggren et al. 2015; Turnheim and Geels 2019). This study specifically examines how incumbents consolidate multiple niche innovations, leveraging technological knowledge, institutions, policies, and infrastructure. By integrating transition studies with organizational theory, it investigates the evolving strategies and roles of South Korean public enterprises in advancing hydrogen energy transitions (van Mossel et al. 2018; Mäkitie 2020).
Methods:
This research conducted a qualitative multiple-case analysis of three South Korean public natural gas enterprises through the MLP framework. Data were collected from news articles, internal publications, and annual reports spanning the 1990s to early 2020s. The study also analyzed enterprises’ intellectual property portfolios, internal research projects, and infrastructure assets by using public data. I used public data and the WIPO database to cover all patents filed by public gas enterprises for the patents (n=768) and selected hydrogen-related patents among them.
Findings:
Using the MLP framework, this research revealed strategic and organizational shifts among incumbent regime actors over the past two decades. First, in terms of landscape-regime interaction, obligations from international agreements intensified as South Korea’s economy grew, increasing pressure on public enterprises to lower carbon emissions. Second, as public enterprises had built expertise in gas infrastructure, they were able to independently conduct R&D and patent hydrogen-related technologies at the niche level. Lastly, national hydrogen policies evolved alongside the maturing natural gas regime, enabling the repurposing of existing infrastructure, such as pipelines, for hydrogen production and transport.
Significance:
These findings enhance our understanding of how public enterprises adapt to climate challenges, emphasizing the role of technological infrastructure as a long-term asset. Moreover, the research offers insights for policymakers and public enterprises, particularly in resource-limited countries, on leveraging existing assets for sustainable energy transitions.
Partnership and Attitudes: Unlocking the Smart City Paradox of Success and Failure in Africa
ABSTRACT. Cities are launching various smart city projects to resolve their urbanization issues and challenges (Snow et al., 2016; Yin et al., 2015). Cities are adopting smart city projects and technologies to improve service delivery, sustainability, infrastructure, quality of life, and governance (Angelidou et al., 2018; Giffinger et al., 2007). As of 2015, about 250 smart city projects have been launched worldwide (Angelidou, 2015). Despite the proliferation of smart city projects, some are failing and scaling back on their promises (Sax, 2022). While we know why some smart cities are vibrant and thriving, we know less about why some projects face false starts or are abandoned. My paper attempts to address this gap in the literature. I intend to focus on how public-private partnerships and attitudes affect the success of smart city projects using the mixed method research approach, interviewing elites and surveying citizens in Accra, Ghana, and Kigali, Rwanda.
Between Competition and Openness: Drivers of Scientists' Data Sharing Behavior and the Tension Between Norms
ABSTRACT. This paper explores the tension between competitive and openness norms underlying data-sharing practices in scientific research, focusing on scientists' dual demands for career advancement and social responsibility. As open science has increasingly become a core concept among academics and policymakers, data sharing is widely promoted for its potential to enhance research transparency, replicability, and interdisciplinary collaboration (Vicente-Saez & Martinez-Fuentes, 2018; Wilkinson et al., 2016). However, scientists face multiple competitive pressures in practice: while the transparency and efficient resource promoted and strongly supported by open science, the demands of academic competition and intellectual property protection present significant barriers (Borgman, 2012). Grounded in social exchange theory and norm conflict theory, this study addresses three key questions: (1) How do competitiveness norms inhibit scientists' data-sharing behavior? (2) How do openness norms encourage data sharing? (3) How do tensions between these norms affect scientists' data-sharing decisions under different contextual pressures? Social exchange theory provides a framework for understanding how scientists weigh personal benefits against data-sharing costs (Haeussler, 2011), while norm conflict theory explains the decision-making process when scientists face competing pressures from both competitive and openness norms (Franzoni & Sauermann, 2014). This study tests these hypotheses using data from the 2024 Science Impartiality Survey, a representative random sample of U.S. academic scientists across six disciplines, collected by the Science Panel Opinion Survey at Arizona State University.
The variables in this study include scientists' data-sharing behavior (dependent variable), competitiveness norms and openness norms (independent variables), and data sensitivity and policy pressure (moderating variables). Competitiveness norms primarily manifest as scientists' concerns for data confidentiality and intellectual property protection in the face of publication pressure and career advancement needs, while openness norms encompass academic transparency needs and social responsibility, emphasizing data openness and the social contribution of scientific research. As one moderating variable, data sensitivity reflects the degree of privacy, ethical, or commercial risk associated with scientists' data, and policy pressure. Another moderating factor, policy pressure, comes from requirements set by funding agencies and academic journals for data sharing.
By exploring the tensions scientists face in open science practices, this study enhances understanding of the motivations behind scientists’ data-sharing practices. It also offers policy recommendations to balance incentives for data sharing with career advancement needs, promote sustainable open science, and address public expectations and concerns.
Reference
Borgman, C. L. (2012). The conundrum of sharing research data. Journal of the American Society for Information Science and Technology, 63(6), 1059–1078.
Franzoni, C., & Sauermann, H. (2014). Crowd science: The organization of scientific research in open collaborative projects. Research Policy, 43(1), 1-20.
Haeussler, C. (2011). Information-sharing in academia and the industry: A comparative study. Research Policy, 40(1), 105–122.
Vicente-Saez, R., & Martinez-Fuentes, C. (2018). Open science now: A systematic literature review for an integrated definition. Journal of Business Research, 88, 428–436.
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., ... & Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018.
A Comparative Analysis of Artificial Intelligence Patents in the United States and China within the Sustainable Development Goals Framework Using Large Language Models
ABSTRACT. Artificial intelligence (AI) has entered the pacing stage of its technology cycle, marked by rapid advancements in performance and a sharp rise in patent filings since 2020. This stage is crucial—its future trajectory will significantly shape its societal and environmental impact. Patents, as one of the innovation indicators, offer insights into strategic areas of focus within the field and the future directions of technological progress. This study draws on two primary theories of patents. Reward theory posits that patents incentivize innovation by granting territorial exclusive rights, reflecting the national priorities of different countries. Contract theory highlights patents as instruments of social exchange: they provide temporary protection in return for the public disclosure of innovations, fostering broader societal benefits over time. While the societal implications of AI patents are increasingly important, the empirical evidence in this area remains under-explored. Focusing on AI patents from the U.S. and China, two global leaders in AI, this study explores how recent innovations align with the United Nations Sustainable Development Goals (SDG) to evaluate their potential societal and environmental impact.
This study identified AI patents using keywords defined in the World Intellectual Property Organization (WIPO) report, including terms such as machine learning, neural networks, and deep learning, alongside related Cooperative Patent Classification (CPC) codes. These patents were searched and retrieved from The Lens, covering granted applications from January 2020 to June 2024. After removing duplicates, a total of 69,523 patents from the U.S. and 126,485 patents from China were identified. Textual descriptions of these patents were then extracted using Google Patents. To assess the SDG foci of the patents, a high-performance pre-trained large language model (LLM), Llama 3.1, was used to compute the cosine similarity between patent descriptions and SDG keyword embeddings. Similarity scores were evaluated to classify patents as relevant to an SDG based on thresholds determined through iterative sampling and manual review.
The results showed that, among all SDGs, ‘SDG3—Good Health and Well-being’ was the dominant focus for both the U.S. and China. Several SDGs, notably ‘SDG5—Gender Equality’ and ‘SDG14—Life Below Water,’ received significantly less attention. The highest number of patents were related to economic SDGs, followed by environmental and social SDGs. A chi-squared analysis of patent distribution across SDGs between the two countries showed significant results. Post hoc analysis indicated that China contributed more patents to environmental SDGs, particularly ‘SDG7—Affordable and Clean Energy’ and ‘SDG12—Responsible Consumption and Production,’ while the U.S. led in ‘SDG3—Good Health and Well-being,’ ‘SDG4—Quality Education,’ and ‘SDG10—Reduced Inequalities.’ Although the U.S. had more unique AI patents related to SDGs overall, the gap between the two countries narrowed over the observed period.
These findings suggest a common underrepresentation of certain SDGs in AI patenting, particularly those addressing social equity. Notably, U.S. patents aligned more with economic sustainability, while China’s AI patents demonstrated strong potential for advancing green innovations. The results, with reference to reward and contract theories, highlight that while patent distribution can serve as early indicators of SDG progress, divergent national priorities point to an increasing reliance on certain countries to drive solutions to global challenges. This study highlights the importance of the need for well-coordinated international partnerships to harness the unique strengths of each nation in AI innovation toward achieving sustainable development.
Prospects of small modular reactors for urban sustainability and climate resilience: A conceptual foundation and cross-country analysis
ABSTRACT. Cities throughout the world are increasingly challenged to improve urban sustainability and resilience due to climate change impacts while experiencing transformative innovation. However, existing energy mix strategies trigger a tradeoff in urban innovation efforts in achieving these objectives that are central to smart city governance. While less carbon emissions require greater reliance on renewable energy sources in the energy mix, it is exposed to inherent vulnerabilities from varying weather conditions, often leading to large-scale power outages and blackouts during extreme weather events. Although emerging technological advances in the clean energy industry could address many of these conundrums, operational risk, and energy affordability must be ensured, and our conceptual understanding and empirical evidence of such developments remain largely absent from the current urban innovation and smart city literature.
This paper first documents these challenges using cross-country analysis of energy mix, extreme weather events, and resultant losses of various socio economic outcomes among major global cities in the world. It then explores small modular reactors (SMRs), an advanced form of clean nuclear energy that provides greater means for safety and climate resilience, compared to traditional nuclear power plants. We lay out conceptual foundations in which SMRs can play a key role in enhancing urban sustainability and resilience while gathering public support and trust in the operational safety of nuclear energy.
Focusing on the applicability of SMRs and their integration with renewables in the energy mix within the broader context of urban innovation literature, we present key opportunities, challenges, and risks in leveraging these technological advances for smart city development. By using natural language processing techniques, we analyze national energy transition plans, R&D spending, and policy development guideline documents. This paper will present a comparative analysis uncovering which countries are more prepared to become prominent leaders in this innovation space. We conclude the paper with empirical cases where cities are actively seeking to incorporate SMRs in their economic development, energy reliability, and climate resilience strategies.
The findings will inform how cities can invest towards creating more sustainable and climate-resilient urban environments as well as more robust energy security through the lens of energy mix and technological perspectives.
Tracing the Interactions between Policy Entrepreneurs and Business Entrepreneurs in Entrepreneurial Ecosystem: The Case of Shenzhen (1980-2020)
ABSTRACT. The concept of entrepreneurial ecosystems (EEs) has received significant attention due to their crucial role in fostering entrepreneurship. Over the past few decades, a substantial body of literature has explored how interactions among key elements—such as governments, entrepreneurs, and research institutions—stimulate entrepreneurial activities within EEs. However, our understanding of how these interactions drive the development of EEs, particularly in shaping their resilience, remains incomplete. This research gap may impede a comprehensive understanding of the heterogeneities of EEs over time and across different regions. Our study aims to address this gap by providing a detailed classification of multi-entrepreneur interactions within EEs, elucidating how these interactions influence the functioning of EEs.
This research builds on the dynamic lifecycle model of entrepreneurial ecosystems proposed by Cantner et al. (2021) and its adapted variant by Shi et al. (2022), which offer a structural and chronological framework for examining the evolution of an EE. Drawing insights from their work, we conducted an in-depth case study of the Shenzhen entrepreneurial ecosystem (EE) from 1980 to 2020, investigating the interactions between two major types of entrepreneurs: policy entrepreneurs (from government) and business entrepreneurs (from the private sector). Policy entrepreneurs are further categorized into central and local government policy entrepreneurs, while business entrepreneurs are divided into leading companies and small- or medium-sized enterprises (SMEs).
This study employs the process-tracing method, utilizing archival and interview data to map the underlying interactions between different entrepreneurs during the development of the Shenzhen EE. Process-tracing has been widely used for modeling and assessing causal relationships or mechanisms in complex systems. Moreover, it emphasizes the sequence and timing of events, making it ideal for capturing multi-entrepreneur interactions over time. We propose that the evolution of the Shenzhen EE can be divided into four phases: pre-emerging, birth, growth, and maturity. Each phase is characterized by specific entrepreneurial activities or phenomena, carried out by distinct entrepreneurial stakeholders. Additionally, the evolution of the Shenzhen EE is shaped by historical reforms and regional cultures. Process-tracing enables us to further illuminate how interactive mechanisms can be influenced by different cultural and social contexts.
Our findings indicate that interactions between policy and business entrepreneurs over the past four decades have not only created diversity at the micro-level but also established coherence at the macro-level within the Shenzhen EE. This diversity and coherence are crucial "inputs" for building the EE's resilience. By examining the underlying interactions between different entrepreneurial agents, this research bridges the gap between innovation policy literature and entrepreneurship literature. This research provides valuable insights for stakeholders across various sectors, including policymakers, entrepreneurs, and researchers interested in the dynamics and resilience of entrepreneurial ecosystems.
References:
Cantner, U., Cunningham, J. A., Lehmann, E. E., & Menter, M. (2021). Entrepreneurial ecosystems: a dynamic lifecycle model. Small Business Economics, 57, 407-423.
Shi, X., & Shi, Y. (2022). Unpacking the process of resource allocation within an entrepreneurial ecosystem. Research Policy, 51(9), 104378.
Examining how assemblages are formed in emergent responsible management practices: An actor network-theory approach
ABSTRACT. Introduction
We studied solar taxiing, an e-mobility initiative in Sub-Saharan Africa, to contribute to the discussions on responsible management (RM) practices by exploring new forms of arrangements through which responsible management practices emerge alongside new ventures. We investigated unique dynamics of how various actors assemble to frame and constitute responsible management practices, defined as the integration of ethics, sustainability and responsibility into routine activities to harmoniously fulfil stakeholder interests (Carroll et al., 2020; Laasch, Suddaby, Freeman, & Jamali, 2020b; Nonet, Kassel, & Meijs, 2016). Using the actor-network theory (ANT) approach, which is a socio-philosophical approach to understanding complexities by analysing relational elements (Arnaboldi & Spiller, 2011) to produce account of how science, technology and social realities are made (Latour, 2007), we investigated this initiative to study how actors assemble to translate climate change and social problems to responsible management practices. Grounded on ANT’s concept of agencement, which states that all participants in a system, be it humans or nonhumans, have equal agency to affect any given situation (Latour, 1987), we use the term “actors” to refer to both humans and nonhumans. Thus, we conducted this study to answer the following questions:
(1) How do actors in socio-material entanglements assemble to create new form of arrangement that constitute responsible management (RM) practices and
(2) how do responsible management (RM) practices emerge out of the socio-technical systems created through the assemblage process?
Methodology
Data Gathering
We gathered the empirical material using multiple sources including interviews and ethnographic observations. We conducted a 6-months on-site ethnography. The principal investigator travelled to Ghana for the fieldwork. He recorded his daily observations into the field notes, taking supporting pictures and videos. He conducted open-ended semi-formal interviews which lasted from about 15 minutes to an hour and 30 minutes. At the end of the ethnography 86 interview responses were gathered, along with 6 policy documents.
Data analysis
We unpacked the translations in the solar taxiing project by analysing four aspects of each event identified in the solar taxiing project. We focused on discovering – (1) what happened, (2) who and what were involved, (3) when did it happen and (4) how did it happen. These four thematic foci guided us to develop the thematic areas of the study. We used rounds of inductive and deductive coding to extract the order concepts, refine them, cluster them and aggregate them into themes and sub-themes. We used three rounds of open coding, axial coding and theoretical coding to develop a data structure using the Gioia methodology (Gioia & Pitre, 1990; Magnani & Gioia, 2023). We open-coded the interview transcripts and field notes by capturing key texts in the transcripts and field notes. In line with the Gioia methodology, after the open coding, we moved on to identify the first order concepts. We developed a third level of coding in which we fitted the codes into a coherent storyline.
Results and Findings
We found that three dynamics occur in the translation process – (1) complementing and competing dynamics, (2) enabling dynamics, and (3) transformative dynamics. These complementary dynamics occur in the form of associations, partnerships, collaborations, appeals and commitments. Enabling dynamics occur through mandating, tasking, connecting, granting access and approving. Transformative dynamics involve actions such as implementing, capturing, assimilating, transforming, utilizing, testing and repurposing. It comprises roles conjointly performed by the actors to change a situation or to modify the identity of the actors.
We found that these dynamics occur in four translation turning points of (1) applying old technologies in new ways, (2) enrolling new actors and developing new technologies, (3) (Mis)aligning interests and aligning abilities with opportunities, and (4) setting boundaries and objectives for the actor-network and protecting these objectives and boundaries with rules and regulations.
Discussions and Conclusion
In this research, we studied solar taxiing, an e-mobility project which has been in operation in Sub-Saharan Africa since 2019, and we drew empirical insights to give an elaborate account of how various socio-material actors assemble in an actor-network, frame, and produce RM practices in unique ways that have not been explained by existing theories. Using actor-network theory as the heuristics and theoretical paradigm, we used the bottom-up approach rather than the top-down approach which has been widely established in extant literature as the way of understanding RM. This bottom-up approach helps understand how the empirical phenomenon connect to and deviate from existing theories (Caruana, Glozer, Crane, & McCabe, 2014). The approach to studying this was to investigate how localized RM practices emerge, get territorialized and institutionalized and disrupt existing models (Czarniawska & Joerges, 1996).
Through the empirical analysis, we bring to fore the complexities and dynamics associated with the emergence of RM practices in a marginalized context, and in so doing, we open the gateway for discussions that challenges the status quo, the present structurisation of RM practices, and existing reporting frameworks. We advance that it is not always the case that there is consciousness and intentionality behind RM practices, but that RM practices could emerge unconsciously and unintentionally as a detour from some other mainstream intentional and conscious process. We demonstrate in this study that RM practices do not necessarily emerge from corporations. We found that organisations (particularly new ventures) could rather emerge as unintended product of RM practices.
We theorise that (de)stabilising events in the form of (1) matters of concerns, (2) failures and successes, and (3) controversies and tensions result in various programs of actions which yield responsible management practices as both intended and unintended consequences, and that new ventures emerge out of these arrangements, quite unique from what we know in traditional literature that RM practices originate from corporations.
Implication of research and recommendations for future research
We have less knowledge of how responsible management practices are emerging in non-western context such as Sub-Saharan Africa and filling up this deficiency in knowledge could significantly contribute to scientific knowledge and theoretical models in the responsible management discipline. Future studies could explore how the stakeholders in such contexts participate in the process.
Positioning of Research Actors as a New Framework of Research Evaluation: A Demonstration through Interdisciplinarity and Collaboration Patterns of Korean Public Research Institutes
ABSTRACT. 1. Introduction and Research Context
Evaluating research actors is a critical yet complex task, particularly as the scope of science and technology expands to include diverse contributions such as economic benefits, knowledge creation, social welfare, and policy influence (Stephan, 2012; Bornmann, 2012; Reed, et al., 2021). Traditional evaluation frameworks often emphasize input-output metrics like publications, patents, and citations, which fail to fully capture the multi-dimensional roles and impacts of research actors (Godin, 2007; Lepori, et al., 2008). Furthermore, these traditional frameworks struggle to address intangible factors like relationships and systemic contributions of research organizations (Lepori, et al., 2008; Bornmann, 2012).
To address these limitations, this study introduces and develops the concept of positioning of research actors as a new framework for research evaluation. Drawing from the case of Korean Public Research Institutes(PRIs), this paper demonstrates how interdisciplinarity and research collaboration can be used to explore and describe the positioning – roles, functions, and impacts – of research actors within the innovation system. These dimensions are used to examine both tangible and intangible aspects of research actors, offering a more nuanced and holistic understanding of their contributions to the innovation system.
2. Theoretical Framework and Objectives
The positioning of research actors encompasses their roles, functions, and impact within the innovation system, moving beyond simple productivity metrics to emphasize the diverse contributions as well as of research entities (Barré, 2006; Lepori, et al., 2008). Korean PRIs provide an illustrative case study, as they have transitioned from acting as technology importers and disseminators during the country's industrialization period to requiring new roles in a maturing innovation ecosystem alongside private enterprises and universities.
This research aims to:
• Develop a multi-dimensional framework for assessing the positioning of research actors.
• Use interdisciplinarity and research collaboration patterns to explore PRIs’ roles, functions, and impact
• Propose actionable insights for designing evaluation frameworks that align with evolving research priorities and policy goals, moving beyond quantitative metrics
3. Methodology
The study used both quantitative and qualitative approach to assess interdisciplinarity and research collaboration as key indicators of positioning:
• Interdisciplinarity Analysis: Utilizing the framework of variety, balance, and disparity (Stirling, 2007), this analysis examines how research disciplines are distributed, integrated, and interrelated within PRIs’ research portfolios. While variety and balance were calculated based on National Standard Classification of Science & Technology used by the Ministry of Science, Technology and ICT Korea, disparity is complemented by qualitative evaluations of disciplinary characteristics to account for contextual differences across disciplines (Sugimoto & Weingart, 2014; van Dam, 2019).
• Research Collaboration Analysis: Topological network and cluster analyses were used to assess collaboration patterns and the roles of research partners within the network. Additionally, this paper considered varying contributions of partners (e.g., universities, industries) to highlight the different assets each PRI sought through their networks.
This combination of complementary methods enables nuanced insights into the positioning of PRIs by shedding light on different aspects of their capabilities, performances, and relationships within the broader science, technology, and innovation(STI) system.
4. Key Findings
The findings highlight distinct roles and functions of Korean PRIs based on their interdisciplinarity and collaboration patterns:
• Interdisciplinarity Analysis: PRIs are categorized into roles such as fostering and supporting, specialized, and developing. For instance, PRIs with balanced interdisciplinarity profiles often play supporting roles that nurture diverse research activities across other developing PRIs and SMEs.
• Research Collaboration Analysis: Collaboration patterns reveal roles such as bridging institutions that connect diverse scientific fields or specialized actors focusing on applied or experimental sciences.
• Alignment and Divergence: Interestingly, PRIs that act as bridging institutions in collaboration often align with fostering and supporting roles in interdisciplinarity. Conversely, specialized PRIs predominantly focus on applied sciences rather than basic research, which contrasts with national strategies emphasizing the development of basic sciences.
5. Implications and Contributions
The results underscore the utility of positioning as a conceptual and evaluative framework. Key insights include:
• Policy Alignment: By revealing discrepancies between national research priorities and institutional roles, the framework highlights areas for strategic alignment, such as increasing support for specialism in basic science in PRIs.
• Comprehensive Evaluation: Comprehensive Evaluation: Positioning integrates tangible and intangible dimensions, addressing gaps in traditional metrics and offering a holistic view of research actors' systemic contributions. For example, a PRI could play an important role in development of a niche research area, despite a low number of publication or citation due to the nicheness of the research area.
• Strategic Guidance: The nuanced insights from positioning indicators can inform policies that optimize the roles of research actors in achieving diverse STI goals, from economic growth to knowledge creation and societal welfare.
6. Conclusion
The concept of positioning of research actors offers a robust framework for addressing the complexities of research evaluation. By integrating interdisciplinarity and collaboration patterns, this approach moves beyond conventional metrics to provide a comprehensive understanding of research actors’ roles, functions, and impacts. Applied to the case of Korean PRIs, the framework demonstrates its potential to uncover multi-dimensional contributions and inform more nuanced and effective research policies. This work not only advances research evaluation methodologies but also supports the broader goal of fostering sustainable and impactful innovation systems.
7. Bibliography
Barré, R.,2006. Towards a European STI Indicators Platform(ES-TIP). Paris, PRIME annual conference.
Bornmann, L.,2012. Measuring the societal impact of research. EMBO reports, 13(8), pp.674-676.
Godin, B.,2007. Science, accounting and statistics: The input-output framework. Research Policy, Volume36, pp.1388-1403.
Lepori, B., Barré, R. & Filliatreau, G.,2008. New perspectives and challenges for the design and production of S&T indicators. Research Evaluation, 17(1), pp.33-44.
Reed, M. S. et al.,2021. Evaluating impact from research: A methodological framework. Research Policy, 50(4), pp.104-147.
Stephan, P.,2012. How Economics Shapes Science. 1 ed. Boston:Harvard University Press.
Stirling, A.,2007. A general framework for analysing diversity in science, technology and society. Journal of the Royal Society Interface, Volume10.
The impact of publicly funded programs in sustainability: The case of the São Paulo Research Foundation in Brazil
ABSTRACT. Introduction
As nations develop economically, environmental concerns have become more prominent. Historically, progress was often equated with development, overlooking environmental impacts. The excessive use of natural and finite resources has contributed to climate change.
To address this, diverse efforts have emerged to mitigate human impact on nature, involving companies, universities, and funding agencies in promoting sustainable research. This study examines the influence of three programs funded by the São Paulo Research Foundation (FAPESP) in Brazil: BIOEN (Bioenergy Research Program), BIOTA (Biodiversity Research Program), and RPGCC (Global Climate Change Research Program). We assess their global contributions by analyzing articles linked to these programs through DOIs provided by the FAPESP virtual library.
BIOEN: Bioenergy Research Program
BIOEN fosters research and development in bioenergy, integrating academic and industrial efforts to advance knowledge and applications in Brazil. Its objectives include nurturing academic inquiry, training skilled professionals, and encouraging collaborative research among São Paulo universities, research institutes, and corporations.
BIOTA: Biodiversity Research Program
Launched in 1999, BIOTA aims to study, map, and evaluate São Paulo State's biodiversity, contributing to forest conservation policies and sustainable exploitation of plants and animals. With over 1,200 experts, the program focuses on inventorying biodiversity, defining conservation strategies, and exploring economic and sustainable uses.
RPGCC: Global Climate Change Research Program
RPGCC advances knowledge in climate change to inform policy development and technological solutions for mitigation and adaptation. The program emphasizes regional and paleo-climatic observations and explores diverse areas such as ecosystem impacts, greenhouse gas emissions, agriculture, human health, and socio-economic responses to climate change.
Preliminary Results
Data from the FAPESP virtual library and Dimensions search engine revealed:
BIOEN: Of 130 DOIs, 51 publications were identified, primarily in Agricultural, Veterinary, and Food Sciences, Biological Sciences, and Environmental Sciences. These publications formed seven conceptual clusters with 97 concepts and 1,217 co-occurrence links. The authorship network included 32 researchers, mostly from Brazilian institutions, collaborating with 17 countries across 81 co-authorships.
BIOTA: Of 328 DOIs, 128 publications were found, with Biological Sciences, Ecology, and Environmental Sciences as the most represented fields. Five conceptual clusters emerged from 100 concepts and 1,770 co-occurrence links. Brazilian researchers dominated, with collaborations across 37 countries forming 183 co-authorship links.
RPGCC: Of 492 DOIs, 113 publications were identified, focusing on Earth Sciences, Atmospheric Sciences, and Environmental Sciences. These formed four clusters with 100 concepts and 1,554 co-occurrence links. The authorship network included 77 researchers and 395 co-authorship links, with most contributions from Brazil, followed by the United States, the United Kingdom, and Germany.
The University of São Paulo played a pivotal role in supporting these studies, alongside institutions like INPE (National Institute for Space Research) and São Paulo State University. International collaboration, while present, remains limited, highlighting potential for broader partnerships to address global environmental challenges.
Conclusion
Our findings underscore FAPESP’s significant role in advancing environmental research through these programs. The dominance of Brazilian institutions reflects strong domestic collaboration but also points to opportunities for expanding international cooperation to enhance research outcomes and tackle global sustainability issues.
A Missing Link of R&D Investment and Outcomes: Moderating Effects of Gender Diversity
ABSTRACT. Under-representation of women in STEM has been a persistent issue in S&T policies of many countries. With rising attention to the implications of gender diversity for research performance and innovation, this study investigates the moderating effects of gender diversity in linking investment and outcomes of R&D in the South Korean context in an attempt to find out how gender diversity mediates the efficiency of R&D investments for innovative outcomes. Answering this question will not only provide insights for policies for women in STEM but also for innovation studies and policies.
Gender diversity in research performance has been extensively studied, though findings remain inconsistent. In the South Korean context, Han et al. (2021) found a negative relationship between gender diversity and both the number of SCI publications and patent applications in government-funded research institutes. Conversely, Kim and Hwang (2022) observed a positive association between gender diversity and intellectual output in the South Korean energy sector. More broadly, gender diversity shows mixed impacts on innovative outcomes. While it significantly influences technological innovation in automobile companies (Hyun, 2023), studies have reported an inverted U-shaped relationship with innovation outcomes (Nakagawa and Schreiber, 2014; Sastre, 2014; Capozza and Divella, 2023).
In general, previous studies have focused on the direct effects of gender diversity on research output and innovation outcomes; very few have explored its role of moderating R&D inputs and outputs. This gap calls for a deeper investigation into the interplay of R&D investments, gender diversity, and performance outcomes. Using the data on government-funded research projects from 2017 to 2022 from the National Science and Technology Information Service (NTIS) of South Korea, this study examines how the effects of government funding on various project outputs such as publications, patents, and technology royalties vary by gender diversity of the research project team.
A mixed-effects modeling approach utilizing fixed and random effects is employed to address the hierarchical structure of panel data. With the research funding as an independent variable, the fixed effects model tests a moderating variable – gender diversity of the research team against control variables such as the principal investigator’s gender, research team’s educational diversity, institution type, project stage, project field, etc. Random effects are included for projects and years to capture unobserved heterogeneity. The models also apply the time lags of zero to three years between research funding and outcome production, based on previous studies exploring the relationship between research inputs and outputs (Lee and Choi, 2015; Subramanian et al., 2016; Xie et al., 2020). Plus, weighting is applied to single-year projects to address different project periods to prevent underestimation of variation caused by multiple replicated values.
Our preliminary findings reveal the critical roles of gender diversity in understanding the returns on R&D investments, providing evidence-based implications for integrating gender diversity into R&D and innovative strategies. Furthermore, the findings highlight that promoting gender diversity is not simply a matter of gender equality but can be a crucial strategy for innovation.
Large-scale analysis of publication characteristics reveals science's evolving interdisciplinarity and internationalization
ABSTRACT. The perception that science is becoming increasingly internationalized and interdisciplinary is widespread, yet quantitative evidence at the disciplinary level remains limited. In this study, I leveraged comprehensive digital repositories of scholarly metadata to investigate trends in interdisciplinarity and internationalization across different scientific disciplines. Focusing on well-established, high-impact, peer-reviewed journals in biology, chemistry, economics, medicine, physics, political science, and multidisciplinary sciences, I analyzed the publication records to discern patterns over time. Through mining data from the large-scale, open-source bibliometric dataset OpenAlex and the Clarivate Analytics' Journal Citation Reports for disciplinary classification, I selected journals based on their long publishing history, high annual article output, significant impact factors as of 2022, and emphasis on original research over review articles. This selection included seven multidisciplinary journals and sixteen journals for each of six disciplines across the natural sciences (chemistry and physics), life sciences (biology and medicine), and social sciences (economics and political science). These findings support the perception of a nearly universal trend toward increasing internationalization in both multidisciplinary and discipline-focused journals. However, notable disparities exist among disciplines. Medicine journals are less internationalized compared to other fields and show little increase in internationalization over time. In contrast, physics journals exhibit a segregation between highly internationalized and less internationalized journals. Additionally, while multidisciplinary journals have experienced significant shifts in their disciplinary focus over the past century, disciplinary journals have largely maintained consistent levels of interdisciplinarity. These results highlight the complexity of trends in scientific publishing. While international collaboration is generally on the rise, the extent and rate of this increase vary significantly between disciplines. Understanding these patterns is crucial for policymakers, publishers, and the scientific community as they navigate the evolving landscape of global science.
Examining the Implementation of Mission-Oriented Innovation Policy: A Case Study of the Energy Earthshots Initiative
ABSTRACT. Research questions:
The operationalization of mission-oriented innovation policy (MOIP) is a significant area of science, technology, innovation policy, and transformation studies that requires further investigation. This study addresses this crucial gap by conducting a comparative case study on the German Energy Research Program (ERP) and the Energy Earthshots Initiative (EEI) through in-person interviews and document analyses.
The ERP has already presented five distinct missions to foster the transformation of the German energy sector towards a net-zero goal in 2045. The Biden-Harris administration assembled eight “shots” to reach the same goal for the United States. The DoE, its ARPA-E, and other Departments and Agencies execute the EEI by funding research projects nationwide, from basic research to more mature technology.
With a conceptual background in evolutionary economics (Nelson und Winter 1985) and experience in transformation studies a project at the professorship has already analyzed the governance of the German case.
However, the focus on the EEI’s governance presents a unique opportunity for further investigation and a perfect comparison case. As both energy innovation research programs can be perceived as mission-oriented, this research design offers a novel and unique opportunity for an inductive approach to how mission orientation is or could be operationalized.
For this purpose, professionals in the EEI realm will be interviewed, and all relevant documents regarding the EEI will be coded jointly with the interviews' transcripts. Primarily, the case of the EEI could provide valuable insights into how to push forward energy transformation, a prospect that we eagerly anticipate.
• Which specific processes are pivotal in the governance framework for implementing the "Energy Earthshots Initiative"?
• In what manner is the governance framework structured within the "Energy Earthshots Initiative," encompassing its organizational components, decision-making processes, and mechanisms for stakeholder engagement and coordination?
Methodology:
The suitable research design for this purpose is a qualitative case study grounded on in-depth interviews, aligning with the methodological framework by Yin (2018) and a document analysis (Miles et al. 2014; Saldaña 2013).
Literature review:
As stated above, there is a conceptual gap in the literature on MOIP. There are many studies on the U.S. National Innovation systems. Moreover, there are studies on technologies included in the EEI with a focus on including US cases (e.g.,Andreasen und Sovacool 2015; Wachs et al. 2023; Woodall et al. 2022). What is more, studies are providing a nuanced overview of the innovation policy landscape of the United States (Bonvillian 2022; P. Shapira et al. 2010; Liu 2022) and some, which shed light on the energy innovation policy in particular (Stevens et al. 2023; Popp 2020). Taking one step further in this research, Arnulf Grübler et al. (2012) investigate the governance of U.S. policy. Concerning comparing Germany and the United States, the work by Hommes et al. (2010) is the most recent update on the general NIS. For the ARPA-E, there are some excellent studies, even based on interviews in recent years (Azoulay et al. 2019; Bonvillian und van Atta 2011; Carleton und Cockayne 2023; Haley 2017; National Academies of Sciences, Engineering, and Medicine 2017; Watson 2022).
In sum, some studies examine most of this research's pillars. However, more literature is needed on the governance of energy innovation policy in light of the EEI and more landscape political changes like the IRA.
Moreover, the recent changes in the political landscape (Geels 2020) add the issue of the robustness (Sørensen und Ansell 2023; Sørensen und Torfing 2024; Trondal et al. 2022; Ansell 2024) of the EEI and its executing actors to the lenses analyzing the governance of the EEI.
Findings:
Since the interviews have just started the findings based on the interviews are preliminary. The document analysis reveals some interesting insights already. The shots have been announced over the course of three years and encompass mostly technology-driven cost or efficiency targets which feed in the grand societal challenges of decarbonization. A minimum of two offices, under the umbrella of the undersecretary for science and innovation, are spearheaded on a shot. Since all shots are connected to existing DoE programs, there is no additional funding in place but additional goal formulation and alignment of the efforts. The newly founded Energy Earthshot Research Centers (EERCs) are led by a DOE National Laboratory and display the cross-office character of the EEI. Some shots, for example, the floating off-shore shot, include other departments. Thus, coordination, reflexivity in terms of feedback, and the continuous alignment of the goals to the grand challenge are core tasks and encounters for the governance framework of the EEI. The inaugural summit organized by the leading office expresses that those principles of MOIP are constantly accounted for. Those events function as a tool to spur first informal and later on formal coordination mechanisms in the community working on a specific shot and provide the opportunity for feedback along the vertical and horizontal structure of actors. Additionally, regular shot-specific teams across the DoE offices convene in meetings to align their activities and discuss new funding opportunities or requests for information, etc., to foster the horizontal coordination of the policy mix.
Other actors within the DoE play smaller but potentially crucial roles in executing the EEI. For example, ARPA-E supports the technologies and potential projects that could feed into the shots. It has a direct connection to practitioners working on the “next big thing.” The loan programs could provide crucial funding to assist technologies or projects closer to market entry because it is not bound to TRL 1-3.
The reaction of EEI’s actor eco-system to the political landscape shift cannot be evaluated at this point to a full scale. Looking at the threats the ARPA-E encountered during the last Trump presidency and how it overcame them, it is not certain that the outlook is indicating EEI is going to cease to exist. Likely, there will be budget cuts and changes in the personnel (cuts) and strategies of robustness, for example rebranding of some parts of the program or highlighting the pillars suitable for the new political agenda.
Simulating Safety Zones for Sustainable and Equitable Lunar Resource Utilization
ABSTRACT. Extracting lunar resources involves navigating the legal complexities of the Outer Space Treaty (OST) while balancing the interests of civil, commercial, and military stakeholders. This is particularly challenging in resource-rich areas of the Moon, where overlapping U.S. and Chinese mission plans could lead to geopolitical tension. Implementing robust governance mechanisms is crucial to upholding non-appropriation principles, mitigating conflicts, and promoting operational harmony. While the Artemis Accords propose “safety zones” to prevent interference, their suitability for large-scale, multinational operations remains uncertain. These zones must balance exclusivity with equitable access to ensure long-term mission efficiency.
The Artemis Accords used the protection principle of safety zones to avoid any interference in lunar activities. However, such zones may have to be expanded and fine-tuned to accommodate commercially viable mining and long-term operational complexities. In my previous work, ISRU (In-Situ Resource Utilization) investigated the economic effects, environmental concerns, and safety considerations of lunar mining compared to terrestrial supply. Using a single-nation model, I identified efficient, low-impact extraction zones and demonstrated gradual resource depletion. This research highlighted the potential for ISRU to stabilize costs despite high initial investments.
Challenges such as overlapping claims and proximity-driven conflicts emerge as lunar exploration shifts to include multiple actors. Terrestrial frameworks, such as the UN Convention on the Law of the Sea, provide valuable insights for managing shared resources. Non-governmental entities such as the Open Lunar Foundation have also called meetings on improving safety zone proposals, which present possible channels for multi-lateral regulation. These frameworks imply that integrated working relationships are required to set limits and manage challenges in a collectively used lunar space.
This research addresses a key gap by integrating multi-actor dynamics into ISRU simulations, providing policymakers with data to evaluate safety zones and shared resource sites. My work will focus on modeling the efficiency and scalability of these zones under various geopolitical and operational scenarios. The simulation will examine critical metrics, such as spatial overlap and proximity impacts, to provide actionable insights for designing equitable and effective resource-sharing frameworks.
My prior ISRU simulation will be the foundation for a multi-actor model incorporating variables such as resource demand, boundary conflicts, and operational scaling. The first simulations will involve two agents, representing a basic geopolitical landscape where the agents’ missions intersect. Data from the Lunar Reconnaissance Orbiter and PSR mapping missions will inform these models' spatial and environmental dynamics. The single-nation model will serve as a comparative baseline, allowing for a clear analysis of the added complexities introduced by multi-actor interactions.
As lunar exploration and the use of space resources increase, creating proper governance in this area becomes critical. This research thus benefits sustainable and equitable space policy by simulating how safety zones and shared-resource sites can promote cooperation and reduce conflicts. This work provides actionable data to civil, commercial, and military stakeholders, forming a basis for agreements that promote resource sustainability and operational harmony. It emphasizes the need for flexible governance to ensure fair resource access and reduce tensions in shared lunar environments.
Tabulation of Platform and Part Sharing Geosynchronous Equatorial Orbit Satellites
ABSTRACT. On October 19, 2024, Intelsat reported that an anomaly occurred on the Intelsat 33e satellite, resulting in a loss of power. Later on, on October 21, 2024, Intelsat confirmed that this anomaly had resulted in the spacecraft breaking up in geosynchronous equatorial orbit (GEO), resulting in a total loss.[1] While troublesome on its own, as space debris in GEO threatens other high-value satellites in that regime, this incident is particularly noteworthy because it follows the breakup of Intelsat 29e in 2019, both of which used the same Boeing platform.[2] While hazardous satellite breakups have occurred in the past, as of 2021 throughout all orbital regimes around 560 incidents have occurred, with only 67.3% of these events being nondeliberate making these events rare.[3] However, for such an incident to happen to the same satellite operator with satellites that utilized the same bus and engine warrants further investigation.[2] While it is certainly possible that it could be just a coincidence, caused by micrometeorite impact or a short circuit, in light of recent controversies surrounding Boeing[4] there are concerns about the seven other GEO satellites that share the BSS-702MP platform.[2] However, it is worth noting that the BSS-702MP is only one variant within the extensive BSS-702 family[2], and even that fails to account for the myriads of other spacecraft suppliers that have their own families of satellite buses. This raises the question: How many satellites in GEO share the same buses? What about sharing the same components? Is part and platform sharing commonplace in GEO? Understanding these patterns contributes to critical risk analyses in the domain. Utilizing a variety of publicly available spacecraft databases and system manufacturing documentation, this report will tabulate their information and map the interconnectivity of parts and suppliers used for satellites throughout the current space environment.
While there has been past literature looking at platform sharing with regard to NASA’s and SpaceX’s launch architecture alongside work noting the flood of mass-produced satellites into space, little to no work has been done to characterize this growth over time within the space industry.[5] A cursory analysis of over 30,000 cataloged satellites and their engine manufacturers using data provided by Seradata, a commercial space data aggregator, shows that major GEO players such as Intelsat and SES have relied on engine suppliers who have also worked on at least another 2,000 satellites. Additionally, while Nammo, the engine supplier for Intelsat 29e and 33e,[2] has supported five separate systems, other suppliers used by SES and Intelsat, such as OKB Fakel and Aerojet Rocketdyne, support as many as 851 and 574 satellites, respectively. How this trend continues for the individual engines and for other critical components, such as batteries or propellant tanks, requires further study. While Intelsat has a track record of transparency regarding anomalies on its spacecraft, other entities may attempt to obfuscate the situation presenting in which any number of satellites could be ticking time bombs, set to go off with little to no warning. This presents not only a critical obstacle for space sustainability efforts but also a credible national security risk to GEO assets critical for early missile warning, nuclear command and control, and signal intelligence. By characterizing and mapping out the current GEO environment, it can pave the way for solutions to these important problems.
1. Stevens, Maureen. “Intelsat Reports IS-33E Satellite Loss.” Intelsat, October 31, 2024. https://www.intelsat.com/newsroom/intelsat-reports-is-33e-satellite-loss/.; Rainbow, Jason. “Intelsat 33e Breaks up in Geostationary Orbit.” SpaceNews, October 21, 2024. https://spacenews.com/intelsat-33e-loses-power-in-geostationary-orbit/.
2. Krebs, Gunter D. “Hughes / Boeing: HS-702 / BSS-702, HS-GEM / BSS-GEM (Geomobile)”. Gunter's Space Page. Retrieved November 21, 2024, from https://space.skyrocket.de/doc_sat/hs-702.htm; Roberts, Thomas G. “The Commercial Space Industry (Part I),” Lecture, Georgia Institute of Technology, Habersham Building, Atlanta, October 24, 2024.
3. Ren, Si-yuan, Zi-zheng Gong, Qiang Wu, Guang-ming Song, Qing-ming Zhang, Pin-liang Zhang, Chuan Chen, and Yan Cao. “Satellite Breakup Behaviors and Model under the Hypervelocity Impact and Explosion: A Review.” Defence Technology 27 (September 2023): 284–307. https://doi.org/10.1016/j.dt.2022.08.004.
4. Chappell, Bill. “How Bad Is Boeing’s 2024 so Far? Here’s a Timeline.” NPR, March 20, 2024. https://www.npr.org/2024/03/20/1239132703/boeing-timeline-737-max-9-controversy-door-plug.
5. Ansar, Atif, and Bent Flyvbjerg. “A Platform Approach to Space Exploration.” Harvard Business Review, September 28, 2023. https://hbr.org/2022/11/a-platform-approach-to-space-exploration.; Roeder, Tom. 2019. Space symposium 2019: Space race going hypersonic with mass-produced satellites, falling costs. TCA Regional News, Apr 14, 2019. https://www.proquest.com/wire-feeds/space-symposium-2019-race-going-hypersonic-with/docview/2209100241/se-2 (accessed November 21, 2024).]
An outline for responsible use at the Earth-Moon Lagrange Points
ABSTRACT. In the Cislunar environment, five Lagrange points uniquely offer near-stationary orbits in the Earth-Moon frame, making them strategically valuable for scientific, commercial, and logistical space activities. Among these, the Earth-Moon Lagrange points host quasi-stable orbits such as Halo orbits and Lyapunov orbits, which present a heightened localized potential for collision. The growing interest in utilizing these orbital regions, coupled with the absence of formalized communication and coordination mechanisms among spacefaring nations, raises critical concerns about collision risks. As the density of assets in the lunar sphere increases, this issue will become a pressing matter, demanding preemptive legislative infrastructure to mitigate risks.
This paper explores and documents guidelines for international communication and collaboration in proximity to the Earth-Moon Lagrange points. It identifies how current intergovernmental treaties and regulatory frameworks, designed primarily for Earth-centric space activities, inadequately address the complexities of this evolving domain. Specifically, it examines the limitations of existing infrastructure in managing operations near the Lagrange points, highlighting the absence of regulations suited to this environment.
Through a high-fidelity simulation environment, this study quantifies the collision risk associated with future missions. The simulations is based on real provisional mission profiles. Analysis suggest that satellites placed in more stable orbits, often a preference due to commercial profitability requirements, face significantly higher risks of collision. These findings underscore the importance of coordination amongst operators to reduce risk while promoting sustainable growth of lunar exploration activities.
Building on this quantitative analysis, the paper proposes amendments to existing international agreements, including the United Nations’ Registration Convention and the ITU’s regulatory framework. Recommendations are made to incorporate specific metrics for this unique orbital category into the Registration Convention, ensuring accurate and detailed reporting of satellite orbits. Additionally, the paper advocates for an expansion of the ITU's framework to include operational guidelines tailored to Lagrange point applications, such as quantifiable thresholds for permissible orbital proximity and collision avoidance. The analysis outlines suggestions for threshold design in this unique orbital environment to coordinate orbiting with close proximity.
In conclusion, while the current level of activity near the Earth-Moon Lagrange points does not yet pose immediate collision risks, historical precedents in space operations suggest that this could change rapidly. Establishing robust guidelines for communication and coordination is essential to avoid future crises. As human and robotic presence in the Cislunar sphere expands, ensuring the safe coordination of assets near these points will be critical. This paper contributes to the ongoing discourse by providing actionable recommendations to advance international regulatory frameworks and promote long-term sustainability in the Cislunar environment.
AI adoption and productivity: Evidence from plant-level data
ABSTRACT. Artificial Intelligence (AI) is a rapidly advancing technological field that promises to have a direct and positive effect on productivity (Brynjolfsson et al., 2019). AI deployment can drive firm productivity through several channels, by reducing costs, creating new products or services, optimizing resource allocation, and improving precision in decision-making (Acemoglu & Restrepo, 2019; Aghion et al., 2019)). Although studies increasingly focus on understanding the productivity effects of AI, current research predominantly relies on indirect estimates of AI adoption, using firm-level surveys (Rammer et al., 2022), vacancy data (Acemoglu et al., 2022), or patent data (Damioli et al., 2020). While more direct worker-level insights have been gleaned from experimental research (Li & Raymond, 2023; Noy & Zhang, 2023), due to lack of granular firm-level studies, little is known about the productivity effects of AI integration into firms’ production processes. As a result, capturing the underlying mechanisms and estimating the impact of AI adoption on workers remains an empirical challenge.
To provide evidence on this, we exploit a staggered rollout of an AI into a specific production task at a multinational manufacturing firm. The task we study is a quality assurance (QA) step in the production of circuit boards destined for the automotive industry. QA is particularly critical for the firm as many of the circuit boards can enter safety critical functions such as air bags. The production line is highly automated. Robots place components and solder onto circuit boards, ovens then melt the solder to attach components. A high resolution camera captures images of the board, these are processed by a digital, rules-based image processor (AOI) to classify images as pass or fail. Due to high quality standards, the AOI often fails to reach the threshold for classification. Therefore, images are then classified by human verification operators. To enhance QA efficiency and performance, the firm introduced a supervised learning algorithm to partially automate this optical classification task across its plants. We use data provided to us by the firm to causally identify and estimate the direct effect of the AI roll-out on labour demand, task productivity, and human decision making.
Our unique dataset contains information on the classification of approximately 188 million images made by operators and/or AI, spanning an 18-month period (2022-24). The data covers 2 phases of AI implementation: Advisory AI (Phase 1) and Autonomous AI (Phase 2). In the Advisory phase, if the operator decision deviates from AI’s, operators are alerted via a pop-up message and asked to revise their decision. In the Autonomous phase, AI takes over the decision-making and autonomously classifies passing images. Images that are classified as fail, or where the AI is unable to reach the threshold, are then blind reviewed by operators. We rely on the variation introduced by this staggered deployment of AI phases (from Advisory to Autonomous) across plants and analyze its impact on workload reduction, productivity, human decision making, and task complexity.
We expect to show that the AI reduces the labour demand for human operators, as the direct result of the automation of the classification task. The anticipated effects for overall productivity are more ambiguous: whilst we expect the AI to increase the speed of the QA process; other effects, such as changes in error detection, could dampen efficiency savings. Finally, we aim to demonstrate a small, but significant, influence of the AI on human decision making when it is in Advisory Phase.
This study makes several contributions to understanding AI’s role in reshaping work and productivity in manufacturing. First, by focusing on task-level data, we offer a granular view of AI’s impact on human work within a specific operational context, moving beyond aggregate productivity metrics. Second, our findings on workload and decision dynamics have broader implications for labor substitution and augmentation, illustrating how AI can either reduce or reconfigure human tasks, whilst also furthering a process of automation in manufacturing. For practitioners, our analysis highlights best practices for implementing AI in critical, high-stakes quality control processes. The staged approach (from Advisory to Autonomous AI) provides valuable insights into gradual AI deployment strategies that balance operational efficiency with the need for human oversight.
References
Acemoglu, D., & Restrepo, P. (2019). Automation and new tasks: How technology displaces and reinstates labor. In Journal of Economic Perspectives (Vol. 33, Issue 2, pp. 3–30). American Economic Association. https://doi.org/10.1257/jep.33.2.3
Acemoglu, D., Autor, D., Hazell, J., & Restrepo, P. (2022). Artificial Intelligence and Jobs: Evidence from Online Vacancies. Journal of Labor Economics, 40(S1), S293–S340. https://doi.org/10.1086/718327/SUPPL_FILE/20462DATA.ZIP
Aghion, P., Antonin, C., & Bunel, S. (2019). Artificial intelligence, growth and employment: The role of policy. Economie et Statistique, 2019(510–512), 149–164. https://doi.org/10.24187/ecostat.2019.510t.1994
Brynjolfsson, E., Rock, D., & Syverson, C. (2019). Artificial Intelligence and the Modern Productivity Paradox. In The Economics of Artificial Intelligence (pp. 23–60). https://doi.org/10.7208/chicago/9780226613475.003.0001
Damioli, G., Vincent, ·, Roy, V., & Daniel Vertesy, ·. (2020). The impact of artificial intelligence on labor productivity. Eurasian Business Review, 11, 1–25. https://doi.org/10.1007/s40821-020-00172-8
Li, E. B. D., & Raymond, L. R. (2023). GENERATIVE AI AT WORK. NBER Working Paper, 82–95.
Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192. https://doi.org/10.1126/science.adh2586
Rammer, C., Fernández, G. P., & Czarnitzki, D. (2022). Artificial intelligence and industrial innovation: Evidence from German firm-level data. Research Policy, 51(7), 104555. https://doi.org/10.1016/J.RESPOL.2022.104555
Design thinking for prototyping and product development within a university-led SMEs cluster initiatives in Bolivia
ABSTRACT. This research addresses the critical issue of design and development of products like production machines for SMEs and rural communities as an essential capability to foster local technology development within the innovation systems of Latin America. What is studied and discussed in this research is the pre-requisites for effective application of design and development methods, like design thinking for prototyping and industrial production machinery, in collaborative spaces of universities and small and medium enterprises (SMEs) in the Bolivian context. For this purpose, the theoretical and empirical perspectives of central characteristics and critical success factors for design thinking implementation for prototyping and product development for SMEs clusters are studied and evaluated. The SME cluster initiatives are facilitated by a public university, which follows the mission of a developmental university through the democratization of knowledge, with one of its principal activities being the design and development of products like industrial production machines. The adoption of design thinking approaches and methods has been introduced as a new tool in the supporting activities between university-industry, to strengthen the SMEs’ and rural communities’ capabilities to design, prototype and develop new industrial production machines and new agricultural production methods.
This research-based framework may facilitate the SME managers’ understanding of how it works and how it can be applied successfully, which is particularly valuable for resource-constrained SMEs. The framework shows central characteristics of design thinking implementation like dimensions of critical factors, strategies, tools, and phases. Based on the identification of the critical factors some strategies emerged to improve the development of prototypes and machines like the use of visualization tools, such as customer journey maps within SMEs cluster initiatives context. This tool inspires and promotes communication with users and stakeholders, to get a deeper understanding of user needs. This facilitates the achievement of more satisfactory results of feasible, viable and sustainable machine projects that are appropriate to the capabilities of users/clients. In resume, this research elucidates some issues on how facilitate the implementation of design thinking for prototyping and product development. It further explores how this approach can contribute to addressing problems within the context of university-led cluster initiatives involving SMEs and farmers with limited resources. This evidence underscores the broad applicability of design thinking approach and highlights the extensive potential for further research into its implementation within this specific context.
Exploring funding mechanisms of scientific collaboration between Taiwan and New Southbound Policy (NSP) priority countries
ABSTRACT. International scientific collaboration defines the fourth age of research, with policy incentives often cited as key motivations for researchers to engage in cross-border collaboration and exchange. However, empirical evidence outside the Western context remains scarce, and the heterogeneity within international collaboration is often overlooked. To address these empirical and conceptual gaps, this study examines the impact of Taiwan’s New Southbound Policy (NSP) on its scientific collaboration with eight designated priority countries, including Indonesia, Malaysia, the Philippines, Thailand, Vietnam, Singapore, India, and Australia, over the period 2011–2021. Drawing on bibliographic data from the Web of Science (WoS) Extended API, we analyzed 28,465 co-authored articles. Funding status is determined based on funding acknowledgments and co-authorship types are assigned according to the country affiliations of first and last authors: TWN-led, NSP-led, Equal, Minimal, and Co-affiliated, based on affiliations.
Our initial observations reveal that 75% of the TWN–NSP co-publications received funding, with 52% supported by Taiwan. Overall, 40% of all co-publications were funded by Taiwan’s grant agencies. TWN-led collaboration had the highest share of funding from Taiwan, with at least half receiving support. In contrast, fewer than 25% of NSP-led collaboration received funding from Taiwan, despite having a comparable funding rate of 75%. Minimal collaboration, where neither Taiwan nor NSP priority authors were first or last authors, experienced a sharp decline in funding from Taiwan, dropping from 65% in 2012 to just over 25% in 2021, despite maintaining the highest overall funding rates. Equal and co-affiliated publications had the lowest funding rates, yet 40–50% still received Taiwan’s support. These preliminary results suggest that the centrality of authors in research, signaled through authorship order, may be closely tied to funding.
Results from the piecewise regressions largely confirm our observations. While the rate of TWN-led co-publications funded by Taiwan barely changes, the number of such publications shows a significant increase, averaging 62 papers per year after 2016. All co-authorship types, except Minimal, exhibit significantly lower numbers of co-publications. After 2016, however, the decline is more pronounced for Minimal, NSP-led, and Equal, each with 84, 49, 38 papers less annually. Regarding funding rates, all co-authorship types, including Minimal, are less likely to be funded by Taiwan compared to TWN-led publications. In particular, the funding rate for Minimal and Co-affiliated publications decline at 3% annually before 2016.
Our present analysis provides indirect evidence of the positive impact of New Southbound Policy (NSP) on scientific collaboration between Taiwan and NSP priority countries from a funding perspective, as reflected in the significant boost in TWN-led co-publications after 2016. For future work, we plan to leverage sentence embedding techniques and Research Organization Registry (ROR) data to better identify the countries associated with grant agencies in our dataset. Additionally, we aim to investigate the internal variations across countries. By doing so, we anticipate gaining a more granular understanding of the funding mechanisms driving the NSP initiative in science and technology cooperation.
A Comprehensive Timeline of Spaceport Camden and Takeaways for Commercial Space Actors
ABSTRACT. Spaceport Camden, a proposed commercial launch site on the Georgia coast was envisioned in the 1960s as the launch hub for NASA’s Apollo program. After losing out to Cape Canaveral, Florida, the site saw little space-related activity until 2012 when Camden County began pursuing its development as a commercial spaceport. With plans for launches by 2020, the project gained momentum, leading to FAA authorization for vertical launches in 2021. However, persistent challenges, including environmental concerns from nearby residents, led the Georgia General Assembly to dissolve the project in 2024 via H.B. 1489. Spaceport Camden offers a detailed case study of how spaceport development collides with socio-political, economic, and environmental realities. While the project aimed to capitalize on the rapid growth of the private space industry, which has seen annual launch rates increase significantly in the past decade, it ultimately services as a cautionary tale about the barriers that can derail even federally approved initiatives. The most recent notable literature discussing the site is from 2019, prior to FAA authorization and the dissolution of the Camden County Spaceport Authority. This undergraduate research provides an updated chronological “biography” of the spaceport, from its early conceptualization to eventual termination. It further describes the socio-political, economic, and environmental factors which made it unfeasible in Georgia. The poster presentation will include a stakeholder analysis of Spaceport Camden, a 1960-2024 site timeline, and a list of takeaways for commercial actors considering spaceport development. Qualitative data sources include state legislative committee transcripts, state legislation, state and federal policy documents (i.e., white papers, fiscal notes, licensing documentation), think tank literature, media publications, and interviews with state policymakers involved in H.B. 1489. Qualitative data is analyzed using thematic and axial coding to identify categories of factors that led the State of Georgia to reject the spaceport. Quantitative data includes economic impact calculations from state and local government reports and statistics pulled from the literature to contextualize takeaways. This work contributes to the evolving discourse on commercial space launch by describing a spaceport case rarely discussed in literature and extracting meaningful takeaways for private actors.
Navigating Renewable Energy Policy: The Impact of Subsidized Solar-Powered Irrigation on Smallholder Farmers in Nepal
ABSTRACT. Introduction and Context
Renewable energy technologies have emerged as a cornerstone of global efforts to address interconnected challenges of energy access, agricultural sustainability, and inclusive development. In Nepal, where smallholder farmers (SHFs) form most of the agricultural workforce, reliable irrigation is a persistent challenge. Limited water access perpetuates cycles of poverty and food insecurity, constraining SHFs’ ability to maximize yields, adopt high-value crops, and build resilient livelihoods.
Solar-powered irrigation systems (SPIs) offer a transformative solution by providing an environmentally sustainable and economically viable alternative to traditional diesel- or electricity-powered pumps. Recognizing their potential, Nepal has implemented a renewable energy policy to subsidize SPI adoption among SHFs. This policy aims to enhance access to irrigation technology, promote sustainable agricultural practices, and improve energy efficiency. However, the adoption of SPIs depends on complex socio-economic and cultural factors, including farmers’ decision-making processes, values, and self-perception within their communities.
Despite the global promotion of SPIs, their impact on SHFs in resource-scarce settings remains under-explored. This study examines the interplay between Nepal’s renewable energy policy and SHFs’ lived experiences, investigating how SPIs influence farmers’ agency, identity, and values. It provides insights into how renewable energy policies can advance innovation, inclusivity, and sustainability.
Research Objectives
This study explores the decision-making processes of SHFs in adopting SPIs, focusing on how their agency, identity, and values interact with policy frameworks and subsidy mechanisms. The research addresses the following questions:
1. How do SHFs exercise agency in adopting SPIs?
2. How does SPI adoption influence SHFs’ identity, particularly their roles as farmers and community members?
3. What values do SHFs associate with SPIs, and how do these values guide adoption and utilization?
The study situates SPIs as a key technological intervention supported by Nepal’s renewable energy policy, assessing their broader implications for SHF productivity and livelihoods.
Methodology
The research employs an interpretive methodology to capture the subjective and socially constructed realities of SHFs. Data collection involved 91 semi-structured interviews conducted across six districts of Nepal, selected to represent diverse agricultural contexts and SPI adoption rates. The interviews, carried out in five phases, provided iterative insights into farmers’ evolving perspectives.
Focus group discussions supplemented the interviews, offering collaborative forums where farmers reflected on SPI adoption and its socio-economic and environmental dimensions. Thematic analysis was used to identify shared patterns, narratives, and contextual differences. This mixed-methods approach ensured a comprehensive understanding of how SHFs’ internal decision-making factors (agency, identity, and values) interact with external influences, such as policy frameworks, subsidies, and local infrastructure.
Key Findings
SHFs’ Agency in Adopting SPIs
While 90% of respondents relied on external assistance to navigate subsidy applications, this did not diminish their active engagement in the decision-making process. About 65% first learned about SPIs through informal networks, such as neighbors or community members who had already installed the system. Observational learning played a key role, with 40% of respondents visiting nearby farms to see SPIs in action before deciding to adopt.
Formal institutions, such as microfinance organizations and ward offices, informed 25% of respondents. Microfinance institutions were noted by 18% for providing detailed guidance on SPI benefits, including 20-year warranties for solar panels and insurance coverage. For 70% of farmers, low operational costs compared to diesel or electric pumps were decisive in their adoption.
Influence of SPI Adoption on SHFs’ Identity
Adopting SPIs reshaped SHFs’ self-perception, fostering a sense of empowerment and resilience. Sixty percent of respondents expressed pride in their ability to irrigate independently, even during power outages or water scarcity. For 45%, SPI adoption symbolized progress, enabling a transition from traditional methods to modern, sustainable practices.
Around 25% of farmers became local advocates for SPIs, promoting the technology among peers. This peer-driven advocacy reinforced their identity as progressive and forward-thinking contributors to agricultural innovation, highlighting the social ripple effects of SPI adoption.
Values Associated with SPIs
SPIs were strongly associated with economic efficiency, sustainability, and reliability. Eighty-five percent of respondents cited reduced operational costs as a primary motivator, particularly in areas with high diesel or electricity expenses. Seventy percent valued SPIs for providing a consistent water supply during dry seasons, addressing critical resource shortages.
Environmental sustainability also resonated with farmers, with 30% emphasizing SPIs as a solution to water management challenges, reducing reliance on fossil fuels. Additionally, 50% highlighted SPIs’ role in increasing agricultural productivity, with some reporting a 20-30% boost in yields due to reliable irrigation. Farmers noted that this technology enabled year-round farming and supported high-value crops like vegetables, ultimately enhancing household incomes.
Factors Influencing the Decision to Adopt SPIs
1. Financial Accessibility: Nearly 80% of respondents cited subsidies as crucial to adoption, reducing installation costs. Post-installation, 85% highlighted the prospect of minimal operational expenses as a key motivator.
2. Reliable Irrigation: Seventy percent valued SPIs’ reliability during electricity outages, particularly for vegetable farming and livestock management.
3. Observational Validation: Forty percent of respondents reported being influenced by seeing SPIs operating successfully in their communities.
4. Environmental Fit: Farmers in regions with declining water resources (30%) appreciated SPIs for maintaining irrigation during dry seasons, ensuring stable production.
Broader Implications
This study highlights the critical role of renewable energy policy in fostering sustainable agricultural innovation. Nepal’s subsidy program has improved SPI accessibility, empowering SHFs to enhance productivity and resilience. However, findings underscore the need for context-sensitive policy design. For example, while SPIs are effective in areas with sufficient sunlight and water sources, their immobility poses challenges for farmers with fragmented landholdings.
Globally, the research provides valuable lessons for policymakers and development practitioners. It demonstrates that renewable energy policies must address social and cultural dimensions alongside technical and economic factors. By aligning with farmers’ agency, identity, and values, such policies can foster inclusivity and ensure equitable benefits for marginalized populations.
At the intersection of innovation, sustainability, and inclusivity, this research contributes to the discourse on how science and technology policies can address global and local challenges. Examining SPIs as a case study, it offers actionable insights for designing policies that support smallholder farmers, promote renewable energy, and advance sustainable agricultural development.
Bilateral Agreements in International Technological Cooperation: A Comparative Study of India-US and Brazil-US Green Technology Collaborations
ABSTRACT. Knowledge sharing and integration are central to addressing 21st-century grand challenges. These function effectively through a strong global institutional network of diverse policies and frameworks. Among the global institutions that integrate the global innovation system, bilateral agreements between countries are among the most important mechanisms. In this background, the current paper explores how bilateral agreements shape the global innovation system, its actors and their networks. Any global innovation system comprises R&D by multinational firms, international technical alliances, international flows of science and technology personnel, joint international publications, international technology transfer and international trade of capital and high-technology goods. This paper specifically addresses bilateral technological collaborations, which have strengthened and amplified in the wake of increasing openness and integration of national innovation systems. An attempt is made to explore the significance and role of bilateral agreements in directing and shaping international technological collaborations and innovation. This question is answered using the case study of bilateral cooperation between the United States and India as well as the United States and Brazil. The US is one of the most influential players in international technology collaborations, with the ability to steer the direction of global cooperation. This study considers the specific technology domain of green technology and analyses the bilateral agreements signed by India-US and Brazil-US in green technology cooperation. India and Brazil are the two most important players from the developing region in the green energy sector with the capability to determine global transition to sustainability. The method used in this study is process tracing. In this method, a causal mechanism is established, a process is traced, and diagnostic evidence is gathered to prove the mechanism. This is undertaken explicitly by examining the trajectory of change and causation in bilateral agreements against the joint patent data, technology trade and FDI and international trade in goods and services complemented by empirical data collected from firms and governments in India and Brazil. The causal factors such as geopolitics, and political and economic relations are also analysed to explain the changing trends in bilateral technological collaborations between these countries. The major output of this research is the trends in bilateral technology cooperation in green energy and green technology, drivers of collaboration, and their significance in developing nations' innovative capabilities.
Reshaping Platform Work Design: The Impact of Algorithmic Management on Job Characteristics and Outcomes of Ride-Hailing Drivers
ABSTRACT. In the context of the platform economy, algorithmic management has greatly changed the form of traditional jobs. Work Design Theory reveals that different characteristics of a job can significantly influence worker-related outcomes. This study investigates how algorithmic management reshapes work design on ride-hailing platforms, specifically focusing on job characteristics and their influence on drivers' outcomes. Based on existing results, we find that different algorithmic management functions directly impact key job characteristics, including autonomy, skill variety, and feedback. These changes have significant effects on drivers' work outcomes at three levels. From performance level, we find a positive association between algorithmic management and efficiency, as drivers follow platform-optimized routes and schedules. From well-being level, due to algorithmic monitoring, job satisfaction may vary, while emotional labor is expected to increase as drivers navigate customer expectations and platform demands. In terms of career level, we anticipate job security to be perceived as volatile, as algorithmic performance rating impact drivers’ access to future work opportunities. The study has practical implications for a better design of platform policies to improve gig workers' well-being and societal inclusivity.
Digital Knowledge Management of R&D Policy and Information: The Case of the Republic of Korea’s National Science and Technology Information Service (NTIS)
ABSTRACT. The Republic of Korea's National Science and Technology Information Service (NTIS) is a pioneering digital platform that integrates and manages national research and development (R&D) information, aimed at improving the efficiency and effectiveness of R&D investments. Launched in 2008, NTIS serves as a comprehensive resource for managing R&D data, performance evaluations, and policy coordination. By centralizing information on R&D projects, researchers, equipment, and results, it enables policymakers, researchers, and the general public to make informed decisions while reducing redundant investments across the national R&D landscape.
NTIS was developed in response to the challenges faced by the Korean government in managing rapidly growing national R&D investments. The absence of an integrated information system hindered the efficiency of government efforts to monitor, evaluate, and coordinate R&D initiatives. Prior to NTIS, various ministries operated fragmented R&D management systems, leading to inefficiencies such as data duplication and difficulty in tracking the outcomes of R&D investments. Recognizing the need for a unified approach, the Korean government, under the Ministry of Science and ICT (MSIT), initiated the NTIS project. The platform was built to provide not only a database of national R&D projects but also analytical tools that allow policymakers to assess trends, monitor project outcomes, and ensure the effective allocation of resources.
The evolution of NTIS from its pilot stage in 2006 to its current version, NTIS 5.0, illustrates its growing capacity to support Korea's R&D policy needs. NTIS 1.0 focused on the establishment of a pan-governmental cooperation system, while subsequent versions expanded its capabilities to include real-time project tracking, enhanced data analysis features, and services tailored to researchers and businesses. By 2015, NTIS had accumulated over 4.7 million data entries and attracted more than 240,000 users, with notable improvements in data accessibility, including a real-time information collection rate of 92%.
Key to NTIS’s success has been its ability to integrate information from over 15 ministries and government agencies, standardize data formats, and provide publicly accessible tools for analyzing R&D performance. This robust system has not only contributed to Korea's innovation policy but has also attracted international attention. Countries like Vietnam and Kazakhstan have sought to replicate the NTIS model, leveraging Korea's expertise in digital R&D information management.
NTIS’s expansion has been driven by increasing demands for more sophisticated analysis, including predictive analytics, trend analysis, and the visualization of research ecosystems. Recent advancements in NTIS 4.0 and 5.0 focus on making data more user-friendly, providing APIs for developers, and introducing intelligent services such as chatbots and advanced data analysis platforms. These innovations aim to make NTIS a more powerful tool for users across the entire R&D policy life cycle, from planning and budgeting to evaluation and commercialization.
The Korean experience with NTIS offers valuable lessons for emerging economies looking to enhance the effectiveness of their R&D systems. Through the establishment of a centralized platform that promotes collaboration, transparency, and data-driven decision-making, NTIS demonstrates how digital knowledge management can significantly improve national R&D policy coordination, increase research productivity, and foster innovation.
Business model innovation in small and medium-sized enterprises within university-led cluster initiatives in Bolivia
ABSTRACT. To engage SMEs in innovation could be important to economic growth in Bolivia, it is challenging to develop and achieve business model innovation due to several factor like inability to establish clear demands for technology, limited access to technological resources, insufficiently educated and trained human resources, and a lack of scientific and technological support. Also, the country's technological capabilities, market access, management assistance and other related factors play significant roles in hindering its innovation progress. This research seeks to explore and advance understanding of how SMEs innovate their business models in a lower middle-income country like Bolivia through participation in university-led cluster initiatives. To achieve the research objectives, a literature review and explorative qualitative research methodology were employed, through case studies and interviews for data collection. Empirical data was collected from the perspective of SMEs’ owners/managers, who receive external support, to examine how tailored support mechanisms can enhance SMEs business models.
Based on the literature review, it was found that universities can influence insights from a diverse range of research studies to support BMI in SMEs, by structuring and designing different support activities. This can be achieved through: Facilitating knowledge or technology transfer from universities, exploring networks of relationships between universities and SMEs, SMEs seeking support to effectively manage and address problems, and the government or other institution incentivize the relationship. Each contributes to BMI by enhancing value creation, value delivery, and/or value capture. Furthermore, when examining how cluster initiatives currently impact the business model innovation of SMEs in Bolivia, the analysis revealed that university support predominantly concentrated on the development of value creation, such as technical solutions and laboratory resources, while less emphasis was placed on the dimensions of value delivery and capture. In this context the focus is on technology transfer and capacity-building; however, there is a need for more comprehensive support in value delivery and capture dimensions. Additionally, successful cases of SME business model innovation in this context, have innovated their business models in two principal ways: following a technology-driven BMI pattern, with a circular approach and technology and product development and/or innovated with a market-driven pattern, with market focusing and customer understanding and expanding customer access. Macroeconomic factors supports good access to natural resources and reliance on the informal part of the economy. In the successful cases, we found adherence to regulations and use of higher education resources as important factors for the SMEs’ enhancement of their value creation and capture processes through continuous business model innovation.
In conclusion, this research elucidates the complex interplay between various stakeholders and factors influencing BMI in Bolivian SMEs. By leveraging support activities in collaborative university and other partnerships, SMEs can navigate challenges and capitalize on opportunities to drive business model innovation.
Recent trends in the institutional environment of STI policy in Uruguay: some lessons and challenges
ABSTRACT. Latin America’s development continues to be a major challenge. By 2023, the decade’s average annual growth has been only 0,8%, far below the 2% of the so-called “lost decade” of the 1980s (CEPAL 2023). Empirical evidence indicates that the modest achievements are associated with low investment in Science, technology (STI) and innovation activities (Daude and Fernández-Arias 2010, Crespi and Zuniga 2012). In LAC, the average investment in R&D&I in relation to Gross Domestic Product (GDP) was 0.75% (RICYT, 2021), while the average for OECD countries is 2.4%. This historical gap in the public-private investment in innovation between LAC and OECD countries was one of the aspects that legitimized the recommendations that insisted on focusing levels of investment in R&D and innovation by means of different strategies (Arocena, 2004). One of the recommendations was the creation of Innovation agencies, as relevant institutional phenomena in countries with highly dynamic innovation systems such as Finland and Sweden. At different times in the 20th and 21st centuries, they were also present in the systems of developing countries such as Brazil, India, and Thailand. Despite this, there is still no agreed definition of what an innovation agency is, as each country has proposed an ad hoc definition based on the specific characteristics of its innovation system and the functions it performs (Foro Consultivo Científico y Tecnológico, 2010).
This work focses on this specific area of research, and aims at problematizing the science, technology and innovation (STI) governance and government in Uruguay. More specifically, it studies the evolution of the STI institutional environment, and the specific role of the executive agency of research and innovation (ANII). The paper seeks to contribute to the theoretical and empirical debate on this type of executive agencies, which are a fundamental pillar of STI policy in the Latin American region, the associated principal-agent relationships, and their consequences on the orientation and type of STI policy instruments designed and implemented in Uruguay. Questions like how were the innovation policy instruments adapted to the Uruguayan context? Have the design and implementation of these instruments undergone modifications under governments of different ideological signatures? What specific characteristics of these instruments have been shaped by the country's political regime and culture? In this sense, this proposal seeks to contribute to the discussion on how Uruguay adapted international policies and discussions on innovation to its local context.
Until recently, since the beginning of the current century, Uruguay’s science and technology environment was heavily concentrated on the single public university, Universidad de la República, a very large institution with 175 years of history and more than 150,000 students, which was complemented by the Clemente Estable Biological Research Institute (IIBCE, 1927), and reinforced by the Program for the Development of Basic Sciences (PEDECIBA, 1986) (Davyt 2012, Baptista 2016, Bortagaray 2017, Zeballos Lereté and Bianco 2021). The early ages of the STI in the 1960s, were defined by the the creation of the National Council for Scientific and Technical Research (CONICYT), as in most Latin American countries (Sagasti 2011, Feld 2020). The new century brought a new governance system, with a more complex institutional environment related to STI policy, with a new Agency of Research and Innovation (ANII), an inter-ministerial cabinet on Innovation, a new public technological university, (UTEC), the Pasteur Institute of Montevideo, and the strengthening and increase of STI policy instruments (Bianchi, Bortagaray et al. 2021). The novel institutional design kept some fragments of the previous landscape, while introducing novelties aimed at the transversality and hierarchical articulation of the policy setting (Ardanche 2012, Bianchi, Pittaluga et al. 2016, Zeballos Lereté and Bianco 2021). The new design pursued the specialization of the actions of design and regulation at the Inter-ministerial Cabinet, of deliberation at the CONICYT and of execution at the ANII (Ardanche 2012). For the Inter-ministerial cabinet to operate, it required specific political powers, to act as the principal, and the capacity to control ANII’s actions. This institutional architecture worked between 2005 and 2016. The lack of that ruling actor, in charge of defining the normative orientation of STI policy had severe effects on the STI institutional environment. To explore these implications, the paper concetrantes on a novel program, the Uruguay Innovation Hub (UIH), designed in 2022 and instrumented only this past year, for the promotion of innovation, to “propel Uruguay to the forefront of the knowledge economy” by “consolidating the local innovation ecosystem through the implementation of new instruments and the development of initiatives that foster collaboration and synergies among the various actors in the ecosystem”. Its implementation has been accompanied by a substantive change in the governance of the Agency, which has not been openly discussed or explained, but which seems to have major implications on the Agency’s autonomization from its principal and the controlling mechanisms, which in turn affects the innovation policy instrument promoted. The absence of control has been reinforced by a low political prioritization, the absence of a problem-oriented framework, the lack of a holistic innovation policy (Borrás and Edquist 2019), and the incipient emergence of actors that captured the design of innovation policy instruments in their own interest.
The analysis is based on official documents and interviews with qualified informants, and a historical approach through which the different events and their implications on the governance of STI policy in the country are traced. The work concludes with some general reflections, and working hypotheses for future research agendas in the field of STI policy studies.
Examining the Effect of Patent Filing on Venture Capital Acquisition: The Moderating Role of Collaborative Patents in the Field of Artificial Intelligence
ABSTRACT. Background and Rationale
Artificial intelligence is a field that has made another revolution in the Fourth Industrial Revolution and has become one of the most widely used emerging technologies in the present era. Further investigation of the trends in this field shows that it has shown increasing growth in recent years. Also, in the future, this trend will continue and fundamental changes will occur in societies. For these reasons, countries must definitely pay the necessary and sufficient attention to this field in their growth and development path. To achieve this growth path, it is intended to evaluate the status of leading countries in the field of artificial intelligence using two key variables in technological fields as a model for other countries. Patent is an indicator that can measure the level of innovation within a company or country. On the other hand, patents in their commercialization process require investment. In reality, there is a significant gap between capital markets and the financing of research and development (R&D) sectors. The primary reason for this, lies in the imperfect flow of information about the potential success of a technology between R&D of the firms and investors. The relationship between firms and venture capital investors is hindered due to the absence of reliable information flow. The major challenge for venture capital investors in entering a high-tech market is the information asymmetry and the high level of uncertainty stemming from the lack of familiarity with firms. Investors are unable to accurately assess the true potential of firms for innovation and their performance. Our main theory is that patents signal investors and demonstrate existing innovation. Patents have the message of novelty (inventive step) and utility of the innovation. Patents, once registered, acquire a new entity and are regarded as a category of assets belonging to firms. Investors also choose among various options based on the quantitative and qualitative status of patents. In the present study, the quantitative characteristics of patents are considered and the relationship between the number of artificial intelligence patents and attracting venture capital in this field will evaluate. Another quantitative variable that can attract investors is the number of patent applicants. A higher number of individuals or firms involved in a patent reduces the perceived risk of low quality in the eyes of investors. This indicates that more entities are invested in its success. The more connections individuals and firms have with a patent, the greater its potential customers. We also will investigate the effect of collaborative patents as a moderator variable; supposing that the more collaborative patents in the countries, the more relationship between major variables (here as: patent and VC). Collaborative patents send stronger signal to VCs, in aspect of the idea of the patent is more valuable just because of it has more than one applicant. So, our research question is: What is the impact of patent filing on the amount of venture capital acquisition? Additionally, how does this impact change when considering the effect of collaborative patents?
Methodology
For this purpose, we will integrate the data of number of patents and the amount of venture capital investment in some selected countries. We choose leading countries in the field of AI. Our time scope is between the years of 2012 and 2022; In these recent years, the growth of AI is salient and this would better guide us to make implications. We use artificial intelligence cooperative patent classification (CPC) technology classes of patents in Lens.org database to finding all AI patents. For collaborative patents, we look at the applicants of patents, if there are multiple applicants from single country this is a domestic collaborative paten; and if the applicants are from different countries, this patent is an international or foreign collaborative one.
The fixed-effect regression model will use to measure the constant effects between the main variables. Also, the variable of the number of collaborative patents will consider as a moderating factor for the effect of the number of patents on attracting venture capital. In order to controlling the endogeneity in major variables, we want to examine the effects under the condition of time lag effect of independent variable. We also, use time lag effect of dependent variable in a two-step system GMM for Robustness analysis.
Anticipated Results
Ultimately, we suppose to have positive and significant relationship between the number of patents and the amount of venture capital attracted in different countries. We also, aim to evaluate various scenarios of the impact of collaborative patents including the presence or absence of collaborative patents, number of collaborative patents, and number of foreign collaborative patents on the relationship of the main variables. At first glance, it seems that having collaborative patents will lead to positive and significant responses.
Artificial intelligence as one of the key pillars of the Fourth Industrial Revolution, will be extensively utilized in the process of digitalization in the coming years. Recent advancements in the growth of patent numbers, the widespread adoption of its innovations in various products and processes, and the increase in investments in this field all support this claim. Therefore, it’s so important to figure out the relationship between two crucial variables in innovation ecosystem in AI field. This would have great implications for policy makers to how can regulate in order to foster amount of capital invested in their countries.
The effects of technological innovation on sustainable development in Africa across climate regimes.
ABSTRACT. The implementation of sustainable development (SD) has been gaining traction among organizations, communities, scholars, policy makers, regions, and nations. The literature does, in fact, agree that innovation-centered techniques should be used to address sustainability. Therefore, the new Agenda 2030 for Sustainable Development is built on the seventeen Sustainable Development Goals (SDGs) and associated 169 objectives (sub-goals). They fairly consider the economic, social and environmental objectives of sustainable development (Dhahri and Omri, 2018). However, to achieve these objectives will necessitate taking steps or measures in a number of areas such as exploring and optimizing the potential of technological innovation (Cancino et al, 2018).
Globalization has made easier for developed nations to transfer new technology to developing countries. Though, this spread of technology innovation has not often translated into actual real economic growth due to lack of technological capacity and ability of countries to promote innovative structures.
However, numerous scholars have already shown the importance of technological innovations in attaining sustainability (Divella and Sterlacchini, 2021; Su and Moaniba, 2017; Hu, 2020)
Despite the interesting role played by technological innovation in fostering a sustainable society. The existing literature on the theoretical and methods used, have some gaps.
Theoretically, most scholars focused on the impact on the technological innovation on each aspect on the three pillars of the sustainable development, such economic growth, preserving the environment and social progress (Ahmad, et al. 2020; Shen. et al. 2021, Benn et al. 2021, Raihan, et al. 2022; Chen, et al. 2023; Sharif, et al. 2023). Few studies have experimentally investigated the impact of the technology innovation simultaneously affecting the three pillars of sustainable development. A study by Ormi, (2020) investigated the ability of the technological innovation of simultaneously affecting economic growth, social progress and environmental quality in 75 low, middle and high income countries by demonstrating the effect of the developmental stages of countries. The findings revealed that technological innovation contributed simultaneously to the three pillars of sustainable development in the long-run but only for developed economies and not effect is observed for middle and low income countries. However, this paper did not take into account of the heterogeneous effect of the technological innovation on the sustainable development in these countries. Methodically, the impact of technological innovation on sustainable development across climate regimes has not been investigated as well. Climate regimes, following Magazzino et al (2021) and Espoir. et al (2022), is understood as given the variety of climate and temperature in one land area (in one country), the primary factors used to classify countries into one given regime are the dominance of a particular climate in that specific land area.
In recent years, innovation in climate mitigation technologies has seen significant progress. The stage of the climate change tends to push more works in order to adapt and mitigate its effect. Sharing the insights of the level the technological innovation to promote a sustainable society might be crucial for policy makers, scholars, industry.
With regards to these gaps, the aim of this study entails to investigate the ability of technological innovation to simultaneously promote economic growth and human development, and reduce the effect of climate change in Africa across climate regimes. Two hypotheses are therefore derived: first hypothesis assumes that technological innovation simultaneously increases economic growth and human development, whereas the second assumes the effect differs across climate regimes
In order to close this gap, we consider 6 African countries (i.e Egypt, Mauritius, Nigeria, Tunisia, Uganda, and South Africa) for the period 1990-2020 due to data availability, one country per climate regime is selected (like in Magazzino et al. 2021). This is due to the fact that most countries do not have information on the technological innovation index. Using Espoir et al (2022), the continent of Africa can be classified into six climatic regimes (subtropical moist (STM), subtropical dry (STD), warm temperature moist (WTM), tropical moist (TM), tropical dry (TDR), and tropical desert (TDS). We collected data Gross domestic product per capita, CO2 emissions, Human development index, Technological innovation and governance index.
Findings revealed that technology innovation contributes simultaneously to the three pillars of sustainable development but the effect is heterogeneous in Africa in the long-run. The results reveal also that climate change increases the demand of technological innovation while the quality of governance has detrimental effect. Our extended analysis based on climate regimes, revealed that technological innovation and others covariates are affecting each other in heterogeneous fashion in each country. Climate change increases the demand for technological innovation in Tunisia in regime STM, South-Africa in regime WTM and Mauritius in regime TM. Future research directions policy and implication are also discussed.
Analyzing the trends of historical satellite conjunctions for different LEO regimes and satellite operators using conjunction data messages
ABSTRACT. Undergraduate researcher for the poster presentation:
Low-Earth orbit (LEO) has seen unprecedented growth in the number of satellites reaching orbit over the past decade. This increase in space activity is largely driven by the deployment of large satellite constellations, ridesharing, and space commercialization. [1] In addition to operational assets, orbital debris such as rocket bodies, metal shards, remnant pieces of spacecraft, and defunct satellites pose a significant threat to the continued operation of satellites in LEO. With the rapid growth and congestion of LEO space activity, satellite operators in this environment are experiencing increasingly closer conjunctions, meaning satellites and orbital debris are passing closer to one another with more frequency. [2] Current conjunction risk assessments are provided mainly by the Combined Joint Force Space Component Commander (CJFSCC) and the 18th Space Defense Squadron (18 SDS) through space situational awareness (SSA) services.[3] These conjunction warnings, given in the form of conjunction data messages (CDMs), contain valuable information for satellite operators including basic satellite information (name, type, etc.), time of closet approach, collision probability, among other metrics which are outlined in the Conjunction Data Message Blue Book.[4] Apart from satellite operators using individual CDMs to inform about potential high-risk conjunctions, CDMs have not been extensively analyzed in aggregate, particularly in a historical context. Some research reports including using CDMs to analyze minimum maneuverability requirements, analyzing CDM covariance consistency, and predicting future CDM metrics have been developed.[5] However, there is more to learn from CDMs such as determining which operators and orbital regimes are most affected by this growing risk which can help in prioritizing space traffic management (STM) goals.
Proposed STM policies including those developed by Aerospace Corporation Center for Space Policy and Strategy offer few recommendations for how to act during high-risk conjunction events that may require a satellite maneuver.[6] Without clear decision-making norms, operators face uncertainty when responding to conjunction warnings which risk continued satellite operations and future space sustainability in LEO.
This means that there is likely an unequal burden on satellite operators utilizing orbital regimes that are more congested and therefore incur more frequent and higher-risk conjunctions.
This study will examine trends found in historical CDMs to determine whether certain orbital regimes and satellite operators are disproportionately affected. CDMs provided by the Space Force through an Orbital Data Request will be scraped, and based on the specific CDM metrics, conjunction data points will be organized into groups of operator type and orbital regime and compared based on collision probabilities and frequency of high-risk conjunctions. Based on the insights provided from CDM analysis, emerging risk patterns will be determined for satellite operators and orbital regimes. Given these risk patterns which are hypothesized to exist unequally in LEO, this study will provide insight on how collision avoidance goals can be met through policy development to enhance the safety and sustainability of satellite operations.
This research highlights the importance of understanding how different risk levels in LEO conjunction events impact space coordination, sustainability, and security. As mega satellite constellations and large numbers of orbital debris permeate LEO, it is critical to mitigate collision risk and orbital debris creation by developing norms among satellite operators when dealing with high-risk conjunction events.
[1] Gian Luigi Somma, Hugh G. Lewis, and Camilla Colombo, Space Debris: Analysis of a Large Constellation at 1200 km Altitude (paper presented at the 69th International Astronautical Congress, Bremen, Germany, October 1–5, 2018), International Astronautical Federation (IAF), November 2018.
[2] NASA, NASA Policies and Guidance for Conjunction Assessment and Mitigation (October 2023), https://www.nasa.gov/wp-content/uploads/2023/10/conjunction-assessment-and-npr-8079.1.pdf.
[4] The Consultative Committee for Space Data Systems, Conjunction Data Message Recommended Standard, CCSDS 508.0-B-1, Blue Book (June 2013), https://public.ccsds.org/Pubs/508x0b1e2c2.pdf.
[5] Daniel Moomey, “A Framework for Minimum Maneuverability Requirements for Low Earth Orbit Conjunction Assessment, Using Historical Conjunction Data Messages,” Journal of Space Safety Engineering 9, no. 3 (September 2022): 375–384, https://www.sciencedirect.com/science/article/pii/S246889672200043X#sec0001; B. Reihs et al., “Analysis of CDM Covariance Consistency in Operational Collision Avoidance,” in Proceedings of the 7th European Conference on Space Debris, ed. T. Flohrer and F. Schmitz (Darmstadt, Germany: ESA Space Debris Office, June 2017), http://spacedebris2017.sdo.esoc.esa.int/proceedings/sdc7/paper/449/SDC7-paper449.pdf; Francisco M. Caldas, Cláudia Soares, Cláudia Nunes, and Marta Guimarães, “Conjunction Data Messages for Space Collision Avoidance Behave as a Poisson Process,” March 27, 2023, https://arxiv.org/pdf/2303.15074.
[6] Michael P. Gleason and Travis Cottom, U.S. Space Traffic Management: Best Practices, Guidelines, Standards, and International Considerations (El Segundo, CA: The Aerospace Corporation, Center for Space Policy and Strategy, August 2018).
Exploring the Role of Concerns and Perceived Self-efficacy in Driving Generative AI Adoption and Attitudes towards its Regulation
ABSTRACT. Advancements in generative artificial intelligence (GenAI) have given rise to widespread enthusiasm towards the application of GenAI tools in academia settings among educators and students alike. While GenAI offers promising opportunities to transform the future of higher education and the scientific enterprise (Rawas, 2023; Rudolph et al., 2023; von Krogh et al., 2023), the incorporation of GenAI systems also raises potential risks to academic integrity, privacy, and equity (Eke, 2023; Lund et al., 2023). In response to concerns over these potential risks, governments and higher education institutions worldwide are developing regulatory frameworks to stay abreast of technological advancement in GenAI and ensure its responsible use (McDonald et al., 2024; Smuha, 2021).
Academic scientists serve multiple roles in the development, application and governance of GenAI. However, their uptake of and attitudes towards the regulation of GenAI are less documented. In this paper, we draw on data from a 2023 survey of university-based scientists in six disciplines—biology, chemistry, computer and information science engineering, civil and environmental engineering, geography and public health—from a nationally representative sample to examine the underlying factors driving their use of and attitudes towards the regulation of GenAI. The extensive literature on technology adoption has proposed a broad range of theories, including the Theory of Planned Behavior (TPB), the Technology Acceptance Model (TAM), the Innovation Diffusion Theory (IDT) and the Unified Theory of Acceptance and Use of Technology (UTAUT) (Ajzen, 2011; Davis et al., 1989; Fishbein & Ajzen, 1977; Rogers, 1995; Venkatesh et al., 2003). These theories collectively identified several clusters of determinants to technology acceptance, including perceived benefits, perceived costs, perceived ease of use and facilitating conditions. Recent research also shows that risk perceptions over technologies are important factors driving attitudes toward AI use and governance (O’Shaughnessy et al., 2022).
In this paper, we focus on two sets of factors, perceived cost over GenAI and perceived self-efficacy to make hypotheses on their relationship with GenAI adoption and attitudes toward its regulation. We conceptualize concerns over GenAI as a form of perceived cost and measure it with concerns over privacy and concerns over agency loss; and measure perceived ease of use with confidence in teaching and research. Using structural equation modelling, we find that 1) confidence in using GenAI in teaching and research is positively related to the use of GenAI in teaching and research, 2) risk perception over privacy and security is negatively related to GenAI use, and 3) risk perception over loss of agency is negatively related to favor of federal regulation of GenAI. There is no evidence that GenAI use is predictive of attitudes toward federal regulation of GenAI. Our findings offer empirical evidence highlighting the negative impact of concerns on GenAI adoption and provide insights for GenAI developers, users and regulators to promote its responsible use and governance.
Navigating the Future of Biotechnology: Global Policy Shifts and Ethical Challenges in Human Gene Editing
ABSTRACT. This paper analyses the global policy shifts in human gene editing precipitated by the ethical, legal, and societal uproar following He Jiankui's controversial experiments in 2018. These experiments, involving the genetic modification of human embryos, not only revealed deep flaws in the international regulatory framework but also ignited a global debate over the implications of human germline editing. Employing a comparative approach, this study examines the responses from key jurisdictions—China, the United States, the European Union, the United Kingdom, Canada, and India—highlighting the diversity in regulatory adaptations ranging from strict enforcement to more supportive stances towards scientific advancements. Through a comparative analysis of the regulatory histories of cloning and in vitro fertilization (IVF), this paper articulates lessons and strategies for the responsible oversight of gene editing technologies. Emphasizing a stakeholder-centric approach, it advocates for a policy environment informed by empirical evidence and responsive to public concerns. The paper underscores the need for an anticipatory and inclusive regulatory framework that integrates robust ethical considerations and actively engages stakeholders, thereby aligning technological advances with societal values and ensuring ethical integrity and public trust in gene editing advancements. This approach advocates for dynamic governance mechanisms that are responsive to evolving scientific landscapes and public sensibilities, striving to balance innovation with ethical responsibility.
Comparative Analysis of Part-Time vs. Full-Time Ride-Hailing Drivers in China: Impacts on Platform Efficiency and Policy Formulations
ABSTRACT. The platform economy has fundamentally transformed labor markets worldwide, challenging traditional regulatory frameworks and employment relationships. This study examines how worker heterogeneity in China's ride-hailing sector—the world's largest with 5.406 million drivers—influences regulatory preferences and platform efficiency. While existing policies since 2016 have sought to protect platform workers, the prevailing universal protection approach overlooks critical heterogeneity in how workers engage with platforms, particularly the distinct needs of full-time versus part-time drivers.
Through a methodologically rigorous approach combining institutional ethnography and discrete choice experiments (DCE), this research investigates how employment patterns influence drivers' policy preferences across five key institutional dimensions: social insurance coverage, working hour limits, collective bargaining rights, vehicle licensing requirements, and safety training certification. The study employs a three-stage process: preliminary qualitative interviews with drivers, a pilot survey of 46 drivers stratified by employment status (43.38% full-time, 56.62% part-time), and a main DCE study with a D-optimal design comprising 24 choice sets.
Preliminary findings reveal several counterintuitive patterns. Enhanced labor protections may paradoxically disadvantage part-time drivers by imposing inflexible requirements that conflict with their supplementary income-earning patterns. Full-time drivers demonstrate unexpected preferences for operational autonomy over comprehensive social protection, challenging fundamental assumptions about the relationship between employment intensity and desired regulatory protections. These insights suggest that current one-size-fits-all approaches may reduce rather than enhance platform efficiency.
This research advances both theoretical understanding and practical approaches to platform regulation. It extends institutional theory by demonstrating how worker heterogeneity fundamentally challenges assumptions about regulatory legitimacy in platform markets, while contributing to labor market segmentation theory by revealing how different forms of platform engagement create divergent regulatory needs. The findings provide empirically-grounded insights for developing more sophisticated regulatory frameworks that can accommodate worker heterogeneity while maintaining market efficiency, with implications for platform economy regulation globally.
Actors, Ideas, and Interests: Lobbyist Framing of Artificial Intelligence in Canada
ABSTRACT. Since the advent of ChatGPT in late 2022, artificial intelligence (AI) systems have seemingly taken the general public by storm, and policymakers are no exception. Recent data from the nonprofit lobbying research group, OpenSecrets, uncovered that the total number of organizations lobbying on AI issues has gone from 158 organizations in 2022 to over 460 organizations in 2024, nearly tripling in the span of two years. This is a clear indication that interest groups are vying to be heard by politicians and policymakers. Understanding the methods used by these groups will aid in better understanding the forthcoming policy decisions taken by the federal government. In other words, in line with previous literature on lobbying, the ways in which lobbying actors present the impacts of an issue can have a leading effect of changing policy along those lines. In our case, this is the nascent policy arena of AI. Thus, this research aims to improve our understanding of the role interest groups play in shaping issues related to AI. By asking the question, how are issues framed by different lobbyist groups in Canada, this research uncovers the complex power relationships that exist between interest groups and AI legislators. This research conducts a qualitative critical discourse analysis (CDA) of 18 witness hearings held during Canadian federal parliamentary committee meetings related to AI. It is further informed through a theoretical framework that combines both CDA with Agenda-Setting Theory, allowing my observations to be grounded within theories of public administration. By taking a CDA approach to the dataset, this allows us to critically engage with the discourse and uncover the different power dynamics, discursive methods, and issue frames within different AI interest groups. In an emerging policy field such as AI, where policymakers have limited knowledge and industry holds exclusive knowledge, we hypothesize that interest groups act as “gatekeepers of information”, disseminating information according to their respective goals. This reality is especially apparent within sectional groups, where lobbyists tend to dismiss facts that would otherwise hurt their own interests. For example, the tech lobbyists testifying overwhelmingly spoke to the various economic and societal benefits brought about by AI, whilst discounting the technology’s ethical and displacement concerns. We also observe that witnesses from academia take a more impartial stance, acting as a natural “control group” in this setting. Related to lack of representation in public forums, our observations fall in line with previous literature on Canadian tech lobbying, noting that certain groups are often left to the margins of decision-making consultations. These groups include digital rights organizations, public interest advocacy groups, and Indigenous voices. Our findings hope to serve as a tool for policymakers to recognize the dynamics that lobbying has on AI policy. In recognizing that policymakers must often engage with AI lobbyists for expertise – leading to these interest groups acting as gatekeepers of information – legislators should be aware of the power imbalance that exists in the industry.
Understanding Adoption Dynamics: Mobile Applications and Women Smallholder Farmers in Zimbabwe.
ABSTRACT. Since the early 2000s, Sub-Saharan African countries, including Zimbabwe, have experienced significant growth in internet and mobile phone usage, spurring the development of mobile applications aimed at smallholder farmers. These applications are widely recognized for their potential to transform smallholder farming into a profitable enterprise, boost food production, and promote sustainable agricultural practices. Despite this promise, sustained adoption remains a critical challenge, particularly among women farmers, who form the backbone of smallholder agriculture in the region. This study investigates the user-specific factors influencing the adoption of mobile agricultural applications, with a focus on women farmers in Zimbabwe. Guided by the Technology Acceptance Model (TAM), this research addresses three key questions: How does perceived usefulness impact the adoption and sustained use of mobile agricultural applications among women smallholder farmers? To what extent does perceived ease of use drive initial adoption and long-term utilisation of these applications? Which TAM construct-perceived usefulness or perceived ease of use plays a more significant role in shaping adoption behaviour? A cross-sectional design will be employed, targeting 200 women farmers in the Mushandike Irrigation Area, Masvingo Province. Participants will be selected through stratified random sampling to capture diverse adoption experiences. Data will be gathered via structured interviews and open-ended questionnaires and analysed using logistic regression in Stata. The findings will provide a nuanced understanding of the factors driving or hindering the adoption of mobile agricultural applications in Zimbabwe. By identifying key user-specific challenges and successes, this study offers actionable insights for developers and policymakers to enhance the design and implementation of these applications. Ultimately, the research aims to support increased adoption and sustained usage of mobile agricultural technologies, contributing to more sustainable farming practices and improved rural livelihoods across Sub-Saharan Africa.
Indicators across Incomes: A Framework for Mapping Disparate Societal Conditions
ABSTRACT. This proposal outlines a presentation arguing that the current design of the U.S. national innovation system has not adequately addressed fundamental societal issues, and posits that science policy must be intentionally designed to tackle complex, "wicked" problems. This argument is demonstrated through a novel data analysis and visualizations.
● The Core Challenge: Despite significant scientific and technological advancements, the U.S. faces persistent, deeply entrenched societal problems, including socioeconomic disparities, unequal access to opportunity, and uneven resilience to global challenges. This indicates that the current national innovation system, and the science policy guiding it, is not effectively oriented or structured to translate progress into equitable outcomes for all Americans.
● Informed by Prior Work: This perspective draws on extensive work highlighting the limitations of traditional approaches to science and innovation policy in addressing complex societal challenges. Prior work by Dr. Crow has examined the need to rethink structures within science funding agencies ("Time to Rethink the NIH"), the imperative to link scientific research more directly to tangible societal outcomes ("Linking Scientific Research to Societal Outcomes"), and the argument that the science system can become too focused on traditional pursuits rather than engaging with real-world problems ("Overcoming Stone Age Logic"). Discussions on the future of U.S. science policy acknowledge persistent disparities and the need for research structures to adapt ("The Next 75 Years of US Science and Innovation Policy: An Introduction"). The concept of transforming institutional models to achieve greater societal impact and inclusivity ("Designing the New American University") supports the view that a reorientation is necessary for science policy to contribute effectively to broader societal well-being.
● A Novel Analytical Approach: The 1/3 Country Framework: To illustrate the gap between innovation capacity and societal well-being, the presentation utilizes a unique analytical framework that reimagines the United States population
divided into three "countries" based on household income tiers: the Bottom Third, Middle Third, and Top Third.
○ Methodology: This analysis moves beyond simple averages by using income quantiles (specifically, 60 ventiles or 5% population groups within these terciles) as the primary unit of analysis. This approach allows for the examination of how a wide range of social and economic indicators vary across the entire income distribution, revealing granular gradients and disparities within and between these income "countries" over time. This provides a detailed picture of the "lived experience" associated with different income levels, which is often obscured by national aggregate data.
● Evidence from the 1/3 Country Analysis: The presentation's central evidence derives from a series of visualizations generated from this analysis, organized into key domains. The data reveals significant disparities across the income spectrum, indicating where the current innovation system's benefits and opportunities are not reaching all segments of the population:
○ Demographics & Context: The analysis identifies how fundamental demographic characteristics like age and racial diversity are distributed across income levels, providing context for understanding the populations experiencing different outcomes.
○ Economic Opportunity & Hardship: The data reveals the unequal distribution of economic well-being, including differences in income, employment stability, and vulnerability to poverty. This highlights how economic opportunity is not uniformly accessible across the population.
○ Education: The analysis demonstrates how access to and outcomes from education, a factor in social mobility and participation in the innovation economy, are stratified by income. This indicates how the current system may contribute to unequal opportunities for human capital development.
○ Living Standards: The data depicts differences in the material conditions of life, including access to housing, transportation, and technology. This shows how basic living standards vary across income groups.
○ Health: The analysis reveals the impact of socioeconomic status on health and well-being, including disparities in health insurance, self-rated health, and the prevalence of chronic conditions. This indicates how health outcomes are stratified by income.
○ Civic Engagement: The data explores how socioeconomic status correlates with participation in democratic processes and access to political influence. This suggests how disparities in the innovation system may relate to unequal voice and representation in shaping policy.
● Call to Action and Conclusion—Designing for Wicked Problems: The patterns revealed by this analysis indicate that a national innovation system not explicitly designed to address systemic inequities may not achieve broad social progress. The persistent disparities across the 1/3 Countries suggest that current science policy approaches are insufficient. Science policy must be intentionally reoriented to identify, prioritize, and tackle "wicked problems"—complex, interconnected societal challenges that require integrated, transdisciplinary research and innovation efforts focused on equitable outcomes and societal impact. The 1/3 Country analysis provides a data-driven case for this transformation, emphasizing that achieving national prosperity and resilience requires a science policy explicitly committed to fostering opportunity and well-being for all segments of the population.