User:Randyfisher/Evaluation
From WikiEducator
Contents
- 1 Evaluation
- 2 DRAFT NOTES
- 2.1 Demonstrated knowledge and experience in performing review and evaluations using participatory based methodology in a non-profit community-based environment
- 2.1.1 The Council of Ontario University Programs in Nursing - Primary Health Care Nurse Practitioner Program & Consortium, Ontario, Canada (in progress)
- 2.1.2 WikiEducator.org, Commonwealth of Learning, Vancouver, Canada
- 2.1.3 One Change, Ottawa, Canada
- 2.1.4 New Brunswick Community College (Miramichi) & Branham Group
- 2.2 Demonstrated experience in development and management of healthy programs and organizations
- 2.2.1 Jewish Family Service Agency, Vancouver, Canada
- 2.2.2 Health Canada Sodium Working Group, Ottawa, Canada
- 2.2.3 Commonwealth of Learning - Community Media Community of Practice
- 2.2.4 Community College Consortium for Open Education Resources, San Jose, California
- 2.2.5 Commonwealth of Learning - Commonwealth Executive MBA / MPA Consortium and Program, Vancouver, Canada
- 2.2.6 Athena Sustainable Materials Institute, Forintek Canada, Vancouver, Canada
- 2.3 Experience with facilitating review and evaluation processes that promote continuous learning for the organization
- 2.3.1 Commonwealth of Learning - Supporting Public Health, Community Media, Governance & Civil Society, E-Learning programs
- 2.3.2 Health Canada First Nations and Inuit Health Branch, Ottawa, Canada
- 2.3.3 WikiEducator.org, Commonwealth of Learning, Vancouver, Canada & Open Education Resources Foundation, New Zealand
- 2.4 Familiarity with the Organizational Standards and processes
- 2.5 Capacity to produce high-quality material in easy to read, easy to understand formats and in a timely manner
- 2.1 Demonstrated knowledge and experience in performing review and evaluations using participatory based methodology in a non-profit community-based environment
- 3 RAW NOTES
- 3.1 Demonstrated knowledge and experience in performing review and evaluations using participatory based methodology in a non-profit community-based environment
- 3.2 Demonstrated experience in development and management of healthy programs and organizations
- 3.3 Incorporating Business Process Redesign
- 3.4 Experience with facilitating review and evaluation processes that promote continuous learning for the organization
- 3.5 Familiarity with the Organizational Standards and processes
- 3.6 Capacity to produce high-quality material in easy to read, easy to understand formats and in a timely manner
- 4 Future
- 5 Resources
Evaluation
Getting Started - Bio, Etc.
See: Bio - PM, Cross-Cultural Relations, Diversity
DRAFT NOTES
Demonstrated knowledge and experience in performing review and evaluations using participatory based methodology in a non-profit community-based environment
The Council of Ontario University Programs in Nursing - Primary Health Care Nurse Practitioner Program & Consortium, Ontario, Canada (in progress)
- Conducting an operational review of the distance education functions of the PHNCP Program & Consortium of 9 Ontario universities. (The Program comprises 7 Master’s level courses towards a post-Baccalaureate certificate, Master’s degree or post-Master’s diploma). Activities include:
- evaluating value for money of the components of the program;
- making recommendations about how to optimize the use of existing distance education technologies in order to achieve optimal teaching/learning outcomes; and,
- making recommendations on industry standards for the distance education delivery components of the program.
WikiEducator.org, Commonwealth of Learning, Vancouver, Canada
- Conducted community building needs analysis; identified and analyzed fear, anxiety and resistance to change; increased user participation and community growth with knowledge of complexity theory, self-organization and Malcolm Gladwell's Tipping Points. Identified, surveyed and engaged potential contributors and established users to design and implement appropriate and timely performance interventions and facilitate thematically-focused learning communities and clusters; a Skills Certification Program; and capacity-building for Sustainable Projects, Communities & Networks.
One Change, Ottawa, Canada
- Evaluation consultancy to document requirements and use cases for 2nd generation website integrating social media, user communities and three social responsibility campaigns. Conducted 1-1 and focus group interviews; analyzed results and presented recommendations.
New Brunswick Community College (Miramichi) & Branham Group
- Co-managed a strategic planning / review process for an Action Plan for a Virtual Institute of Technology-Assisted Learning co-located at a community college. Worked with management and staff teams to develop, conduct and facilitate focus groups, surveys, public consultations and other diagnostic processes to evaluate organizational and community readiness for change/transition. Groups included local and regional business; provincial and federal government partners, Tele-Education NB and key technology associations. Identified and qualified 50+ partners and $30M in new business opportunities.
Demonstrated experience in development and management of healthy programs and organizations
Jewish Family Service Agency, Vancouver, Canada
- As Program Coordinator, Job Match Services and Employment Counsellor - evaluated clients’ multicultural needs to design and deliver Canada Workplace Culture workshops; liaised with case managers and coached, mentored and counselled immigrant-job seekers to develop job-search strategies / training plans. Helped resolve conflict with cultural sensitivity and counseling skills. Performed gap analysis of paper-based job posting system; analyzed risks and optimized business processes, workload, productivity and communications.
Health Canada Sodium Working Group, Ottawa, Canada
- Design and facilitation of an inclusive and participatory pan-Canadian multi-stakeholder comment process for qualitative inputs and health impacts for the final report of the Health Canada Sodium Working Group.
Commonwealth of Learning - Community Media Community of Practice
- Designed, developed and evaluated communities-of-practice and learning programs, to support community leaders in sharing best-practices and interdisciplinary knowledge for capacity-building in public health, governance, higher education and community media programs in Asia, Africa, the Caribbean and South Pacific. Examples include: an HIV AIDS Treatment Literacy Portal (Africa); LearnShare HIV/AIDS Community of Practice; and a public health training program and materials designed by experts from the International AIDS Society (Switzerland) and experts in community radio. Also developed and planned 'pilot' capacity building for 99 women (33 NGOs in Africa) at Radio Mang'elete (Kenya). Partners: ECONEWS Africa, COL, Radio Mang’elete, UNESCO and the Kenya Community Media Network.
Community College Consortium for Open Education Resources, San Jose, California
A project of The William and Flora Hewlett Foundation at Foothill-DeAnza College, subsequently merged with MITs Open Courseware Foundation.
- Facilitated stakeholder engagement and outreach and increased membership and participation in a consortium of 200+ community and technical colleges. Advised and supported Interim Governing Board, program manager and CCCOER contacts on ways and means of improving performance; recruited, mentored and trained OER ambassadors, faculty, admin and internal champions.
Commonwealth of Learning - Commonwealth Executive MBA / MPA Consortium and Program, Vancouver, Canada
- Project management and coordination to maintain and grow the CEMBA / CEMPA Programs in 10 countries in Asia, Africa, the South Pacific and the Caribbean. Strengthened stakeholder accountability and partner recruitment process. Selected external consultant to recommend revisions to 22 core and supplementary courses. Coordinated learning workshop capacity-building to convert print-based courses into online learning formats.
Athena Sustainable Materials Institute, Forintek Canada, Vancouver, Canada
- Evaluated market for environmental lifecycle assessment software and newly-launched institute. Co-managed 7 member team focusing on survey design, interviews and focus groups, analysis and reporting. Interviewed 100+ respondents in the architectural and building construction sectors in Canada and the US; analyzed data using SPSS, prepared recommendations for new pricing models and business case for $250K investment from the federal government of Canada. A member of our team was invited to sit on Athena's governing board.
Experience with facilitating review and evaluation processes that promote continuous learning for the organization
(: As a result of my experiences with facilitating user / member participation and contributions, and reviewing and evaluating processes in complex, self-organizing online environments, I developed a hybrid performance intervention called Performance Analysis & Action Learning (PAAL), for my graduate coursework in organization management and development, Fielding Graduate University.)
Commonwealth of Learning - Supporting Public Health, Community Media, Governance & Civil Society, E-Learning programs
- Applied change management / performance analysis and action learning methodology to increase stakeholder participation, collaboration and communication with large stakeholders (COL, UNESCO), regional partners/NGOs, and local/grassroots, rural and urban community media / radio, in Asia, Africa and the Caribbean. Developed and revised curricula (based on faculty and student feedback); mentored and facilitated users in LearnShare HIV/AIDS Community of Practice for Public Health Professionals in Africa; Organization Development; and Designing Effective Learning Programs in Jamaica, St. Vincent & the Grenadines, and Ghana
- Used and leveraged the networked tools and connections of Web 2.0 social learning technologies for continuous and iterative (peer-to-peer) learning; building trust with real-time mentoring support to implement workshop / meeting action plans; and a seamless experience between online and face-to-face interactions. Co-developed 3-Os - An Onsite, Ongoing and Online Action Learning Model
Health Canada First Nations and Inuit Health Branch, Ottawa, Canada
- Facilitation support and report-writing for lessons-learned workshop for public health practitioners responding to H1N1 pandemic.
WikiEducator.org, Commonwealth of Learning, Vancouver, Canada & Open Education Resources Foundation, New Zealand
- Used the Performance Analysis and Action Learning performance intervention to engage users / members to participate and contribute ideas, materials and resources; share interdisciplinary expertise; and increase their capacity within online communities and their organizations.
- Conducted formative evaluations on community participation and on-the-job relevance, to increase community participation and member growth, and to identify, engage and mentor opinion leaders in key educational institutions; and for technical and community-participation training modules to respond to community and client requirements; enhance learner outcomes; and increase completion rates
Familiarity with the Organizational Standards and processes
- TBD
Capacity to produce high-quality material in easy to read, easy to understand formats and in a timely manner
- Former business journalist - Globe and Mail, Financial Post, CBC Radio - never missed a deadline
- Completion of research and evaluation reports - Forintek Canada, Branham Group, in plain-language, etc.
RAW NOTES
Demonstrated knowledge and experience in performing review and evaluations using participatory based methodology in a non-profit community-based environment
- WikiEducator Community Needs Analysis
- Forintek Canada / Athena - survey, 1-1 followup
- One Change Community Needs Analysis - 1-1, small groups
- NBCC-Miramichi - survey, 1-1, focus groups, public consultations (SPSS)
- SkyPark Miramichi - survey, 1-1, focus groups, public consultations (SPSS)
- TRIO / OCRI - survey, 1-1, small groups (SPSS)
- Athena - survey, 1-1, small groups
- Community Radio CoP - for shure
- LearnShare HIV AIDS CoP
- Wann Connection Devices, Canadian Bank Note
Demonstrated experience in development and management of healthy programs and organizations
- WikiEducator / OERF - Goal - to increase participation
- Conducted needs analysis, job analysis and target market (market research) analysis to develop appropriate learning solutions, and create ‘readiness’ for people to provide inputs to learning development, and encourage their peers to participate in the solution. I have also conducted formative evaluations of training modules – to more closely align with emerging trends and practices, and respond to client requirements.
- Community Media
- Design, development and evaluation of communities-of-practice, to support best-practices and knowledge-sharing, broadly within organizations and across disciplines, in public health, governance, higher education and community media
- Course development / revision for technical skills training, and to support community-of-practice development
- Facilitation of training programs and groups to build capacity for leadership and technical expertise (Learning4Content project, funded by the Hewlett Foundation); management skill development for community radio stations
- Learning4Content
- Jewish Family Service Agency - internal evaluation; business process redesign; Canada Workplace Culture
- Community College Consortium for Open Education Resources
- CEMBA - * Project management for the Commonwealth of Learning’s Executive MBA / MPA programs in 10 countries. This included the selection of external consultants to revise 22 courses; and conduct a learning workshop to convert print-based courses into online learning formats. Standardized partner recruitment
- Health Canada Sodium Working Group, Canada - Gathered and documented business requirements; surveyed and engaged 35 stakeholders representing Canada’s food industry; used iterative, rapid prototyping to align and design real-time and asynchronous workflows; developed learning and navigation tutorials; and provided 7/24 technical support for secure ICT/wiki deployment with IT consultant.
- Evidence-Based - Michael Calvert
Incorporating Business Process Redesign
- utliizing AI process, generative dialogue, process improvements - AVA
Experience with facilitating review and evaluation processes that promote continuous learning for the organization
- Community Radio CoP
- LearnShare HIV AIDS CoP
- Wann Connection Devices, Canadian Bank Note
- Operations Research Curriculum for Public Health
- Intersol - H1N1 and Sodium Working Group (Public Health)
Familiarity with the Organizational Standards and processes
- TBD
Capacity to produce high-quality material in easy to read, easy to understand formats and in a timely manner
- Examples of written reports
- Former business journalist - Globe and Mail, Financial Post, CBC Radio
Future
- What are your job responsibilities, workload and deliverables?
- How do your job responsibilities, workload and deliverables align to, and deviate from, your job description?
- To what extent do the current services, internal tools and Learning Management System reflect best practices and current knowledge?
- What types of people and organizations, and how many are using the program; which stakeholders have experienced greater success and why; and what is the extent of program penetration in specific institutions and communities.
- How satisfied are stakeholders – and what are the means for evaluation?
- What are the current performance indicators, and are they adequate to support scalability, impact and growth?
- In what ways – directly and indirectly – has the program been improved? Where are the short-term opportunities for improvement, and longer-term impact
- In your view, what are the Strengths, Weaknesses, Opportunities & Threats for this program
- Can you identify specific business processes, workflows that can be optimized, to what benefit and for whom?
- How has program capacity increased (i.e., scale, market reach or extent of impact for target populations)?
- How has organizational management capacities and culture (i.e., leadership, governance, management, HR, IT, budgeting, communications, etc.) supported or hindered capacity-building
- (: See Also OMD Evaluation)
Resources
Translation
- Malcolm Williams, University of Ottawa Translation Services - 613 562 5800 x1572
- Association of Translators and Interpreters of Ontario (referral service) - 613 241 2846 - http://www.atio.on.ca
- Michel Poliquin, Certified English French; French to English - 819 684 0464
- Mohan Rajageopal, 613 741 3567
- Louise Lambeault, 613 730 7670