Showing posts with label tools and references. Show all posts
Showing posts with label tools and references. Show all posts

Sunday, May 25, 2014

Global PA Survey

Request from Stephen to fill out a quick survey on PAs. Please send this out to all your PA contacts in the countries where you are doing your study so their team can get data on as many PAs as possible! This analysis will contribute not just to the GEF evaluation but also to the larger, long-term global study they are doing.


We have set this up a short survey monkey questionnaire to get information on numbers of staff.  It is formatted in a way that requires standard answers.   This is the Task Forces standard short questionnaire that we trying to send to hundreds of protected areas. The links are below. If you could collect this information on-line for each protected are it would be most helpful.  It only takes 5 minutes per park.   We also have it in French and Spanish

https://www.surveymonkey.com/s/PA_survey_English

Wednesday, May 21, 2014

Prepping for interviews

I just wanted to share what I've been doing so far on the interviews. As I mentioned in a separate post, I've been giving short presentations to key informants prior to asking questions so that they know where we are coming from when we ask the questions. A common misconception is that we are here to evaluate the GEF projects; the presentation is meant to emphasize that impact evaluation asks different questions from project evaluation. It seems to be a good way as well to draw out concerns and questions. The presentation is here if you want to have a look. You can modify and use it if you want. I will probably also present this as an intro during the debriefing/ validation meeting with stakeholders at the end of the country visit.

Also, I have been sending out the list of interview topics separated according to stakeholder group and a two-page brief on the evaluation along with the letter asking for interviews from key informants. This helps them get a better idea of what GEF is, why we're interviewing them, and what about, and they generally come very prepared, with relevant documents as well. You can find the folder of interview topics and the 2-pager brief on the evaluation here, ready to send with your invitation email.

What about you, any tips and tricks to share on preparing for and conducting interviews?

Some midstream clarifications on using the data collection instruments

Tim was asking me some questions about the templates, and I thought it might be helpful to post my reply to him here, since he's probably not the only one with those questions.

Why are the questions repetitive?

As mentioned in the Guidance Note, the sections in the templates are intended to be redundant so as to ensure that different aspects of a phenomenon are covered by asking the same question in different ways. However, it CAN get tedious to fill out the tables when certain things come up again and again.

For example, the category of "threat reduction" in the country template (document 3A) under the Environmental Change table (Section IIA), may identify "decline in poaching" as a reduced threat, with "improved enforcement activities" as a contributing factor. "Improved enforcement" might also show up in the table for Change in Capacities, if the improvement in enforcement occurred during the period that GEF support was present. It may also show up again in the Timeline (Section IIB) if this improvement in enforcement started as a result of a specific event or driver, and then again under Management Inputs (Section IIIA) if law enforcement training and equipment were provided as a specific contribution of one of the actors.

To avoid the exercise from getting too tedious, you can either a) copy and paste whatever you've already typed into the boxes where the answer might also be relevant, or b) provide a reference such as "See non-GEF factors in Environment Change, 'threat reduction'" in boxes where the information is also relevant, to avoid repeating the information. The point is, do whatever makes sense for you--the bottomline is that you are able to capture all the information that you have collected.

Let me know if this helps. Have you found a better way to make the process easier? Please share your experience  in the comment box below!

Change starting when?

Another question that may be common is: from when do we start assessing the change? There are two sub-sections assessing change, Section IIA - Direct Changes and Causes and Section IIB - Indirect Change and Causal Pathways.

The first, Section IIA, is meant to document changes that occurred during the period of GEF engagement. So it's important to know when GEF support began and when it ended, and then ask what the state of things  was before this period, and what the state of things is at present or immediately after support ended. The change may not always be a result of GEF support (or not only of GEF support), and this is exactly what we want to find out. GEF support may have funded certain activities that are expected to lead to that change, but asking this question will help us see if indeed it was those specific activities that directly contributed to it.

The second, Section IIB, is meant to document longer-term changes, so we can see if GEF did indeed contribute to major change, or if the events were already headed in that direction anyway. This is where GEF contribution will be more nuanced, as we know that there are so many other larger actors and drivers shaping the sequence of events in a specific context. Perhaps GEF provided the last extra push needed for conservation to be prioritized rather than economic gain. Perhaps GEF came in to lend some sort of credibility when other donors were having second thoughts about continuing their support for PAs in the country. Perhaps the momentum for change started way back when the country gained its independence. Perhaps some other donor or even government would have provided exactly the same kind of support. These are the sort of things that will not emerge unless we look at the long view and ask the question "what might have happened had GEF support not been present?"

What do we do with the Preliminary Analyses?

The Preliminary Analyses forms (document no. 4A, B and C) are meant to help synthesize the information organized in the templates as a bridge between data collection and the analyses that we are going to be doing in June. So filling out the 5 sets of preliminary analyses (PA system + 4 PAs) is very important, as these are what we will be presenting to each other during the calibration workshop.

The country and PA templates will continue to be important as references that we can use to clarify data as needed during discussions, as well as compare answers to specific categories across the countries and PAs. So it's likewise important to make sure the information in the tables is well-presented and understandable. We also plan to aggregate information organized in the templates (quantified, as much as possible) as evidence in the report to support our findings and recommendations.

Below is a flowchart of how the different documents feed into each other. You can click on it to make it larger.



Hope this helps and do share your thoughts below!

Friday, May 9, 2014

Revised and Additional Tools

As I mentioned in my last email, the revised templates can be found here. I have also uploaded the contacts database to this folder, so you can just open the Excel file and filter using the dropdown menu according to your specific country. In addition, I've uploaded the METT that we will be filling out for each PA here. Tim and I will be meeting with the Ministry of Forestry this afternoon and hopefully have a final list of PAs to visit, which we are very, very close to having. Hope to see the rest of you on this blog!

Monday, May 5, 2014

My Next 40 Days and Tools for the Road

And so it begins. I thought I would be gone for a month and a half, but it didn't hit me till the night before I left (when my family pointed it out) that I would actually be gone for exactly 40 days. Religious scholars are very well aware of how 40 is a significant number, especially in Jewish, Christian and even Muslim traditions, as a period of testing and waiting resulting in radical transformation. We shall see then what 40 means for me. I certainly look forward to a transformation, as long as it's not into an even more stressed-out person :P

My itinerary for the next 40 days:

May 5-6   Travel from Washington DC to Jakarta via Narita
May 7-16  Fieldwork in Indonesia
May 17  Travel from Jakarta to Entebbe via Doha
May 18-13 Fieldwork in Uganda
May 14 Travel from Entebbe to Washington DC via Amsterdam

The instruments for data collection can be found here, and the latest versions will always be available at this link as they are updated.