iPEN
  • Home
  • iPEN
  • Training
    • Making sense of impact
    • Te Ao Māori and Impact
    • Clarifying the problem context
    • Planning for impact
    • Developing impact pathways
    • Tracking your impact
    • Extending your impact toolkit
    • Communicating your impact
  • Resources
    • iPEN's Resources
    • Other resources
    • Impact News
    • Professional community
    • Glossary
  • Contact us

Impact News

We know there is lots going on out there and it's hard to keep track!
 Here we share news, webinars, training, or anything else impact-related we think potentially useful.

TRADING OFF IMPACT FOR NOVELTY - FINDING THE BALANCE

11/29/2022

3 Comments

 
A recent article in Nature by Melissa Flag outlines the tensions researchers face when launching their proposals into competitive funding environments where novelty is a key quality criterion rather than usefulness.
Melissa suggests that while researchers are proposing novel research, and reviewers are considering whether proposals are sufficiently novel, real problems facing society today remain unaddressed.

​For many scientists, making a difference through their science is a strong motivator. 
Picture
However, securing funds to embed evidence-based solutions is often a challenge. The potential pathway to outcomes and impacts is disrupted by the inevitable need to propose yet more novel research rather than progressing toward impact, in order to secure much needed funding via competitive processes. Novelty is often bundled with concepts of risk, pushing researchers into realms where current knowledge and accepted principles are applied in `unproved or speculative’ ways, new methods or ideas are proposed, and incremental or ground-breaking advances are made. 

The issue is, does rewarding considerable novelty and risk necessarily ensure the research will deliver usable and useful findings? How much of this type of research can New Zealand afford, compared with nations that deploy substantial funding pools to support basic, untargeted research?

Applied research that has a clear outcome in sight for a broad range of users within a realistic timeframe can deliver real change and benefits for Aotearoa New Zealand’s environment, society and economy. But it may not have a novel and highly risky launching pad. Instead, it might require more resources to support implementation, adoption and adaptation to make a difference. A challenge Melissa notes when she asks, `Who funds implementation?’

It can be particularly challenging to build the novelty and risk case for some types of science because they are perceived to reinforce or protect the status quo (for example, biosecurity and food safety) and, therefore, are perceived not to be inherently risky or novel. 
 if funders `truly cared about broader impact, it would be tracked, measured and used in reward systems’.
Yet there is still a potentially huge number of beneficiaries for this highly valuable research who may not have the scale, level of co-ordination or voice to directly resource or leverage funds to support this research … yet!

Melissa also suggests that if funders `truly cared about broader impact, it would be tracked, measured and used in reward systems’. She calls for science `quality’ metrics to be expanded to `recognize making real-world change’. And she suggests researchers, institutions and funders put more effort into partnering with others who can help take `shiny new ideas’ that otherwise would `never go beyond sparkle’ towards solutions.

Given the considerable need to deliver outcomes from science to safeguard our planet at this concerning time in our history, Melissa calls for funders to think again about the pressure they create for researchers to `simply go on to the next proposal – the next big, new idea, constantly chasing novelty, the bleeding edge of science’.

According to Melissa, this  is a waste. She calls for science policy analysts and funders to make generating practical solutions `enticing to researchers’ and not just something that might be regarded as `volunteer work – not part of a scientist’s job’.

It’s exactly this sort of science that communities pay their taxes to support. There’s no suggestion that curiosity-driven science doesn’t have its place, but it’s time to consider whether discoveries without impact are unnecessarily using up precious time and resources.
3 Comments

data viz with beer

10/5/2022

1 Comment

 
Picture
That's right - even beer (or in this case a calendar for the brewing of beer) can be a great candidate to highlight some of the basic principles of data visualisation.

In our Communicating Your Impact workshop we link to a few of our favourite experts, one of whom is Stephanie Evergreen. In this blog she illustrates how concepts like layout, colour choice, and the use of graphics/images can transform something really ugly and hard to read into something that is informative at a glance.

Why do we care?
One of the many ways that we create pathways to impact is through communication.

Hard to read and understand graphs and graphics are like loud noise at a cafe. Distracting and sometimes just make us leave.

Click on the link above to learn more. Stephanie is also really busy on LinkedIn and regularly shares little pearls of wisdom, so if you're active on LinkedIn follow her there too.
1 Comment

Healthier lives | He Oranga hauora national science challenge takes on the research -> impact challenge

10/5/2022

20 Comments

 
The Healthier Lives NSC has been tasked with researching how to significantly reducing the death and disease burden and achieve equitable health outcomes from four of our biggest 'killer' non-communicable diseases (cancer, cardiovascular disease, diabetes, and obesity).

Like many of us, the team at Healthier Lives were feeling frustrated at how seeming little evidence is making its way into policy and practice - the pathways to having an actual impact from research.

As a result, they organised a hui consisting of a series of webinars (which you can watch here) and then an online workshop to "explore ways to strengthen" these pathways that could be embedded into our new health system.

In the workshop, attendees were asked to consider the following questions:
  • which key elements are required in the future health system to create effective pathways between research, policy, and practice?
  • what culture changes are needed to drive new ways of operating?

What came out of the workshops?

​
Workshop participants agreed that "Aotearoa New Zealand needs more transparent and system-embedded processes" if these pathways from evidence to impact are to be achieved.

The questions prompted the identification of SIX KEY ELEMENTS and FIVE GUIDING PRINCIPLES that are needed if research evidence is going to be effectively embedded and actioned via policy and practice change.

The summary of findings from this workshop have been documented here: https://healthierlives.co.nz/webinar-pathways-between-research-policy-and-practice/, and summarised in the diagram below taken from page 3 of this report.

Only through the implementation of these elements and principles will we be able to "build the necessary processes and foster the collaboration required to ensure the best research is utilised to its fullest potential for the health of Aotearoa New Zealand".
Picture
So what jumped out at us?

Reading through the summary of findings had us nodding our heads A LOT. iPEN has been doing its own work on trying to understand what the systemic barriers and enablers to delivering impact from research, and it was reassuring to read many of the same themes emerging. 

The diagram above notes the critical importance of the 'who and how' (in the guiding principles, and multi-directional access to expertise) which also links nicely to our blog and link to Reed and Rudman's recent article about Rethinking research impact: voice, context, and power at the interface of science, policy, and practice.

They note (when summarising why there is a need for strengthening pathways) that many of the historical mechanisms for bringing wider voices in - who often create or facilitate these pathways - have been largely disbanded. Further, they note that although ad hoc groups might be useful for responding to discrete events (like COVID), they are probably insufficient to address the more 'wicked' diseases this NCS is focusing on as their causes are multiple and systemic.

(Sidenote - those of us who are systems thinkers may be having a 'duh' moment right now. Boundaries, perspectives, and relationships are our starting points.....)

Measuring what matters (what's valued) - even if its hard. Equity is a core focus for our health system, and that ensuring this is actually being realised means having to figure out ways to evidence this so change can actually be monitored and used to inform decision-making at all levels (local, regional, and national).

"While many [principles like tikanga] are widely accepted in rhetoric, they must be reiterated as they require commitment and action if we are to transformatively change the system"

Transparency means communicating information in ways that are understandable to others, and that this is fundamental in building trust and confidence in our findings.

In our iPEN training we acknowledge that when we spend so much of our time talking to our professional colleagues we can forget that not everyone speaks your science language. This can be a challenge as we have been trained to communicate in this way (i.e., with our academic peers through publications using the research equivalent of legalese).

Much like how learning another language is best done via the emersion method, figuring out how to communicate well with your stakeholders means getting to know them, and then using language they understand. 

How does all this link to our training and the advice we give?

​Figure out who your stakeholders and partners are/are likely to be, and involve them in your projects 
from the START. Try to recognise, understand, and manage power dynamics as part of this process, and know that relationships take time to build and maintain (and that this happens before, during, and after the projects themselves). Understand their context and use language and words they understand.

If you can hit all these marks, you'll be well on the way to strengthening your own pathways to impact.
20 Comments

Impact, ‘grimpact’, and what you can do

10/5/2022

1 Comment

 
Have you ever thought about how your work may be perceived and what you can do to ensure positive outcomes are realised? 

 Mark Reed (Fast Track Impact and SRUC) and Hannah Rudman (SRUC) recently raised this very topic in a recent article in Sustainability Science. https://link.springer.com/article/10.1007/s11625-022-01216-w
 
Many of you will now be quite familiar with the concept of impact – benefits (desired changes) resulting from our work, or their potential realisation. By and large we refer to these benefits as occurring beyond academia. 

 But these benefits also have an ‘evil twin’. Some colloquially refer to this as ‘grimpact’ - negative consequences resulting from our work, or their potential realisation. 

 But, who gets to determine what an impact (benefit) is, and why? 
 
Different groups may perceive the same outcomes as either positive or negative, while even “…the same group may perceive an outcome very differently in a different time or changed context”. 
 Reed and Rudman point out:
“It is especially important to recognise this subjectivity... in cases where potential beneficiaries have historically been marginalised or delegitimised by researchers and other more powerful actors as part of a knowledge system that is centred around academic privilege”. 
So then, is our work enabling or perpetuating injustices and inequities? 

It is widely accepted that ongoing appropriate engagement with such groups from conceptualisation of research through to pursuit of outcomes mitigates against the risk of negative consequences being realised or perceived. 

For us in New Zealand we've had somewhat of a head start on these sorts of considerations, as we try to better honour Te Tiriti. Many of us now understand and have experienced that what 'good' looks like very much depends on who you are, where you stand, and the power (or lack thereof) that comes with the 'who'.

But then how should you design your research? By thinking about your DESIGN, and your POSITIONALITY

DESIGN: The authors identify three important considerations for successful research impact design:
  • Context
  • Voice
  • Power
This is all about thinking systematically about who's voices should be in the room and represented, for your particular project or programme, and including them from the get-go.

​While the authors recognise this comes with challenges (particularly in making the time necessary for relationships to be forged so they can and will be 'present') they note:
​
“By not adequately understanding and accounting for the three considerations described … projects risk delivering unintended negative impacts, or no impact at all.”
​

POSITIONALITY: ​An important related matter they also point out is that, despite your best efforts, as a researcher you have considerable influence on the shape and perception of your research.

They then go on to lay bare their identities to provide the reader context, in what some (not me) may find uncomfortable reading. 

Uncomfortable or not, this is useful because it welcomes us to understand the research in relation to its authors in their time, additionally outlining its limitations. It also disperses some of the accountability for the validity or success of the research away from the authors by laying bear some of the (less obvious) factors that may have influenced it.

Failure to understand, respond to, and account for the scope, limitations, and shape of your work unhelpfully biases it, and may lead to unintended consequences such as inaccurate assumptions, poor decision making, or perpetuated injustices. 
​
So, how can you (and we all) integrate these three considerations around context, voice, and power, along with an awareness of your own positionality to better ensure durable beneficial outcomes (impacts) being realised from your work?
1 Comment

RESEARCH IMPACT SUMMIT! Its free

10/5/2022

0 Comments

 
Every year the Research Impact Academy organises and hosts a FREE summit on Research Impact.

Its a great way to hear about what others around the world are grappling with when it comes to effectively evidencing and delivering impact from their research.
​ 
Picture
They give you a few days to access the recordings, and if you feel like paying, you can access all the previous years recordings for up to a year.

We'll be attending, so we'll be posting an update next month with a few of our take-aways. We'd love to hear yours in the comments.
0 Comments

what's love got to do with it?

9/14/2022

0 Comments

 
A couple of weeks ago some of the iPEN team got the chance to journey over to Adelaide, Australia to attend the Australian Evaluation Society Conference.

This conference marked a welcome return to some much missed face-to-face engagement with colleagues, and provided a fantastic opportunity to hear (and see) what’s been exercising our aussie counterparts’ minds.

​We were struck at some of the themes we heard being repeated across sessions. This increased resonance on many fronts, as the future pathways work continues and we cogitate what the future state of the science system might look like.
Picture
Picture
​We noticed many of our colleagues talking about the critical importance of acknowledging and reflecting “place” in evaluation practice. There was also a much more pronounced focus on what good evaluative practice looks like when working with indigenous communities.  And finally, there was an almost unashamed focus on values. While ‘values’ are literally at the heart of the e[VALUE]ation profession, the strength of presentations and workshops around this concept also jumped out at us (including a whole day workshop!)

​So what does this all mean for us?

​These repeating messages about place and values (especially exemplified when considering what good practice looks like when working with indigenous communities) highlighted and reminded us about the importance of acknowledging that the context in which our work happens is huge. It is the main factor that determines what is most important (valued) and for who, and therefore what outcomes and impacts are of greatest interest to “target” when planning any monitoring and evaluation activity.

“What matters and for whom” is a question that is routinely posed and at the core of evaluative practice. This question is all about seeking to understand the context, and consequently the values, of the people, actors, entities, and organisations who have an interest, or role to play, in a given project or programme.

This is equally valid to ask for our science projects and programmes. Impact is a human construct –  by definition it is talking about change. How we judge that – good, bad or otherwise – is completely dependent on the values within that context.

For us, our starting point is MBIE. Their Position Paper on the Impact of Research tells us to look at things like the Living Standards Framework as a starting point. However, this lacks any nuance around how much attention should be given to those big ‘categories’.

Just as we would expect (and require) our schools and hospitals to adapt the education and health care they provide to meet the needs of the local area, this is also needed for our science. While we do “get it” in theory (i.e. not all science can, or should, be commercialised), we don’t often challenge ourselves to do this more systematically. We don’t often ask our ourselves, “what’s going on for our stakeholders, partners, and collaborators? What do they care about? What’s the problem they need solving, and what contribution can we make to addressing this?”

Asking these questions gets to the heart of the matter and that is where the love lies. It’s all about what is cared about (valued) in that particular context, and consequently, the kind of difference (impact) you could make.

The good news!

​Taking time to really engage with the context and values your science is located in doesn’t have to be difficult or time consuming. We know from our training that you often have many of the “answers”, its just having the right tools and guidance to be more systematic about it.

We have links to lots of simple but effective tools in our Clarifying, Planning, and Developing modules and you can find lots of others over on the Beyond Results website (thanks AgResearch!) as well as the Integrated Research Toolkit, hosted by Manaaki Whenua.

And, if you really want to give these a go, come along to one of our workshops. To find out when they’re running just drop us a line via the contacts page.
0 Comments

honing your message to increase impact

8/3/2022

0 Comments

 
In our iPEN workshops, and especially our Communicating your impact module, we talk about how to engage your stakeholders (or engage new ones) and how we need to be clear about what the call to action is.

Given the competing priorities people are likely to be balancing, they need to see enough value in what you're asking them to do to be prepared to do 'something' for you. An effective call to action is important if we care about impact, as without our partners, collaborators, and stakeholders, we have much less chance of the ripples from our research turning into waves.

In our workshops we talk about how we can learn from the 'storytelling' techniques which are widely used by successful public speakers. Guidance given to TED Talks presenters for example, draws heavily on these principles.

 If you're looking for a quick read on what this all means, and what you might need to be thinking about next time you're asked to talk to a group of people that are important to your research take a look at this short read from Duarte on how to develop the best big idea for your presentation.

The article gives some great tips on things like:
  • how to think about what the takeaway message might be
  • how to build a distinct 'point of view' to catch your audience's attention
  • how to figure out what's at stake for your listener, so you can engage them effectively
And if this piques your interest, you might like to follow this up with another short post from Duarte on how to influence through story.

For more ideas and tips, check out our Communicating Your Impact resources page, or get in touch to come along to our next workshop.
0 Comments

12 QUESTIONS YOU CAN ASK TO HELP ENABLE IMPACT

8/3/2022

1 Comment

 
Designing and executing great research means getting your research questions right. They provide us with a scaffolding that keeps us targeted on what we need to focus on and deliver.
Achieving impact from research depends on much the same thing – asking ourselves good questions, only these are slightly different. So what are they? 
While there are many ways you can tackle this, in our time-constrained context borrowing what’s worked for others is a sensible way to go. Fortunately for us, the Our Land And Water (OLW) National Science Challenge has shared what has worked for them!
​In this article on their website, the OLW team share how a water use efficiency project (called Irrigation Insight) evolved from an initial focus on addressing the research question, to developing a solution that farmers could use to solve the fundamental water efficiency challenge.
Picture
​In a nutshell, MS Srinivasan (Principal Scientist, NIWA) found that although he was producing what he thought was helpful information for farmers so they could irrigate more efficiently, his outputs weren’t leading to farmers doing anything differently. 
“When the project started it was easy, as a scientist,
to identify the biophysical problem and the solution....I could find the data,
give farmers the data, and explain how to use a soil moisture sensor –
but ​it wasn’t solving the problem of water use efficiency.”

​- MS Srinivasan
​Through their use of a co-innovation approach, their multi-disciplinary team developed a set of 12 questions (building on work by Donald Schön). These helped to ‘unlock’ their understanding of the context their research was happening in. 
Engaging farmers and other stakeholders through the use of these 12 questions helped MS and the team design a fit-for-purpose project. Then once the project was up and running, these questions were used again, to enable healthy reflection (with their stakeholders) on the progress of the project. 
Building this structured reflection into the project then gave the team the clear rationale for various tweaks and improvements they made along the way to their plan. This was critical to the eventual success of the project.
For the iPEN team, the main takeaway from this success story is by engaging with a wide range of perspectives through really effective stakeholder engagement, allowed MS and his team their work and drive the change he was hoping to achieve.
“It started as a project on 5 or 6 farms, and now we’re ​ looking at
​what it means for the whole country."
Find out how the questions were developed and used and find links to publications: 12 Questions Scientists Should Ask Stakeholders to Increase Research Impact. 

The OLW team regularly share examples of how they are designing and delivering impact through their research. If you want to learn more subscribe to their newsletter!
1 Comment

We aim for “impact” but, what impact do we want?

6/22/2022

0 Comments

 
We often think it’s self-evident what kinds of impact we want to create with our mahi and why it’s worthwhile.

​“Progress studies", an emerging self-styled academic field and intellectual movement, raises the bar for thought on this.
​
"There is no broad-based intellectual movement focused on understanding the dynamics of progress, or targeting the deeper goal of speeding it up. We believe that it deserves a dedicated field of study" 
 Progress studies aims to dissect the causes of human progress in order to better advance it. Progress Studies has a strong focus on economic growth which raises many interesting questions such as, progress for who, and what is progress?

For a brief and interesting read on the history of Progress Studies as well as some of the counter arguments to its tenets check out this great article on the BBC: Do we need a better understanding of 'progress'? - BBC Future

Progress Studies is Monitoring and Evaluation at a macro scale on steroids.
​

The article describes the tensions that can arise when discussing what the issues/challenges/opportunities are for a problem as well as what is the impact/future we want.

It’s a great reminder that having a clear consensus of the challenges to be solved and what outcomes are planned is a great place to start when thinking about any piece of work. It can be helpful to refer to our mission statements or statements of core intent but these can be too lofty. There are tools and processes you can work through to help reach a consensus and a great place to start learning about these is the iPEN training courses. 


Not sure what some of the terms in this blog are? See if we have included them in our Impact Glossary - and if not you you'd like to see them - get in touch and tell us what you'd like to see added.
0 Comments

Boosting impact in South Korean science – read the article in Nature

6/20/2022

1 Comment

 
Nature recently published an interesting article on how funding mechanisms and the incentives/constraints for scientists in South Korea have stifled outcomes and innovation. This is a great reminder that the systems we work in shape our mahi (from the type of research we do to the outputs we create). Being mindful of the context we work in can help us navigate some of the challenges and push for change in a way that will work to create impact.

The Nature article highlights three of the seven themes which iPEN included in our submission to the Te Ara Paerangi Green Paper to enable impactful science.
  • Provide funding stability with flexibility
  • Reward and recognise impactful work
  • Work to align motivations and beliefs of individuals and entities   
 
Despite South Korea’s significant increase in research funding over the past decades, with the Basic Sciences Promotion Act, the article suggests that the inflexible, time-bound approach to research assessment is stifling basic science.
The country is home to world-class scientists but, according to the writer, it is not as productive as it could be, despite sufficient financial resources. This could be attributed to policies being “favouring short-term results over bold exploration”.
Read the article here.
​
1 Comment
Forward>>

    Author

    iPEN is a collaboration across all seven Crown Research Institutes in New Zealand. We're a collection of colleagues all working towards supporting greater impact from our science and research.

    Archives

    December 2024
    October 2023
    July 2023
    April 2023
    March 2023
    February 2023
    December 2022
    November 2022
    October 2022
    September 2022
    August 2022
    June 2022

    Categories

    All
    Call To Action
    Communicating Impact
    Impact
    Irrigation Insight
    National Science Challenge
    Our Land And Water
    Progress Studies
    Reflective Practice
    Research Impact
    Storytelling

    RSS Feed

Home
Picture
Contact Us
  • Home
  • iPEN
  • Training
    • Making sense of impact
    • Te Ao Māori and Impact
    • Clarifying the problem context
    • Planning for impact
    • Developing impact pathways
    • Tracking your impact
    • Extending your impact toolkit
    • Communicating your impact
  • Resources
    • iPEN's Resources
    • Other resources
    • Impact News
    • Professional community
    • Glossary
  • Contact us