Public Health Leadership-Evaluation

What is one of the problems with using competencies as a means of evaluating leadership?

The main problem with competency frameworks is that the competencies are not defined with sufficient specificity to permit their measurement. Competencies need to be broken down into specific components that can be measured. There must be an applied research strategy to evaluate the necessary leadership competencies on a regular basis and the competencies should be updated based on organizational objectives. The process of defining the framework for competency based assessment has only recently been developed and it will take some time for a complete performance standards system to be capable of evaluating leadership outcomes.

What are the pros and cons of credentialing leaders?

The supporters of credentialing argue that credentialing increases the credibility of public health professionals both with members of the public as well as with politicians. Furthermore, they argue that credentialing will enable the development of professional standards. Supporters of credentialing want to link credentialing to licensure. The proponents argue that the process of evaluating professional knowledge helps develop standards for professional performance. The critics argue that no credentialing system is possible because of the multidisciplinary background of public health professionals. Furthermore, they point out that schools of public health are accredited and so a degree from an accredited body should be sufficient evidence of competence.

                I understand both sides of this debate. Before I started graduate school it seemed like such a monumental undertaking that is seemed that graduates must have a special level of expertise. However, as I have neared the end of my course work and gotten to know graduates of this program as well as employees of HHS that have masters degrees, I have come to the conclusion that a person of only ordinary intelligence and character can graduate from a MPH program, and the fact of obtaining this degree may or may not indicate their competence to practice public health. Therefore, I can understand the argument that credentialing may serve to raise the bar and establish readiness to practice. In a sense, the argument that graduating is good enough is akin to arguing that doctors, by virtue of graduating from medical school, are prepared to perform as physicians.  

A report from the association of schools of Public Health discusses the factors that need to be addressed in a sound credentialing program. First role delineation that distinguishes between professionals who have different skills and levels of knowledge is a requisite. Second, the credentialing system must specify the knowledge and skills required to carry out the duties of a credentialed public health leader. Third, the system must determine the education, training, or experience necessary to generate the required competencies. Fourth, a testing procedure or other form of assessment must be devised to determine when a practitioner has achieved entry level competency. Lastly, the system must allow for a process for recertification or maintenance of certification through ongoing professional education.

What are five personal leadership lessons you have learned in the last year?

I have learned that it is important to cultivate emotional intelligence and stay in touch with your feelings. I have also learned that self-care is essential. I have the tendency to want to help everyone else around me and forget to care for myself. It is important for leaders to invest sufficient time in self-renewal and rest. Furthermore the issue of work life-balance is important for public health leaders. In a field where there is so much to be done, and where the workforce is committed to principals of social justice, it is easy for public health leaders to become overly invested in the work they do. I think it is important for leaders to manage their time from an integral perspective, making sure that they preserve work-life balance. Another leadership challenge I have grappled with in the past year is how to inspire a strong work ethic in subordinates. Finally, I have learned to work more effectively with partner agencies by clarifying our respective agendas and better defining our roles in campaigns.

What is a 360 degree assessment?

The 360 degree assessment process involves a multilevel evaluation that focuses on whether the leader’s style of leadership supports or obstructs achievement of the mission and goals of the organization. In a comprehensive 360 degree assessment, all key stakeholders have a voice in evaluating the leader and assessing the direction in which the organization is headed. In order for a 360 degree assessment to be carried out, the leaders of the organization must determine whether sufficient enthusiasm for and commitment to the process exists in the organization and whether they are willing to institute changes based on the results of the assessment. Secondly, they must collect high-quality data. Lastly, they must identify possible responses to the results, such as the development of new training programs and initiatives. The 360-degree assessment utilizes the leadership practices inventory (LPI). The five practices in the LPI are 1) modeling the way, 2) inspiring a shared vision, 3) challenging the process, 4) enabling others to act, and 5) encouraging the heart.

What are some difficulties associated with performing a 360 degree assessment?

A 360 degree assessment is often expensive and time consuming. Measurement instruments must be bought and staff must be trained to interpret the results. Furthermore, leaders must be comfortable revealing their self-perceived weaknesses to their colleagues and subordinates must feel comfortable rating their leaders. The last issue is of special concern in smaller organizations, where animosity could occur between leaders and subordinates if negative feedback is given.  

The rating of leaders is further complicated if subordinates know that ratings will be tied to the compensation of the leader. Regardless of employee’s role (leaders and non-leaders alike) all employees are subject to the exterior phenomena of inflation and if annual salary increases are not provided, then the real compensation of the employee decreases over time. Arguably, one of the key factors that influence health and well-being in American society is SES, which is made up in part by household income. If people are not compensated in such a way as to maintain their household income, their personal well-being may decrease. A public health agency needs to grapple with the issue of fair market value of compensation and how performance and compensation will be linked, when deciding how employees will be evaluated.

A final consideration when an organization is deciding whether to perform a 360 degree assessment, is contemplating whether performing the assessment will make a difference. Perhaps the process for changing leadership is so cumbersome that there is no way a leader can be forced out even if he/she fails to perform at a minimum level. A leader may be protected by political or administrative mechanisms that prevent any punitive action from being taken. If this is the case, a 360 degree assessment could simply be a drain on the organization’s time and resources.

What is qualitative leadership assessment and what are some techniques for performing such an assessment?

A qualitative leadership assessment evaluates the leader based on personal traits and behaviors. There are a number of instruments that can be used to perform a qualitative assessment. These include the Myers-Briggs Type Indicator, The Leader Behavior Analysis II, the Team Leadership Practices Inventory, and the Leader Behavior Inventory.  The Myers-Briggs Type Indicator (MBTI) assessment is a psychometric questionnaire designed to measure psychological preferences in how people perceive the world and make decisions. The Leader Behavior Analysis II is a tool for understanding perceptions of one's style by revealing what direct reports actually experience. It presents leadership situations along with four possible responses. Managers' responses to these situations reveal their leadership style flexibility, their primary and secondary styles, their effectiveness in matching the choice of a leadership style to the situation, and their tendencies to misuse or overuse a particular style. The Leadership Practices Inventory (LPI) is a questionnaire with thirty behavioral statements. Leaders complete the LPI-Self, rating themselves on the frequency with which they think they engage in each of the thirty behaviors. Five to ten other people—typically selected by the leaders—complete the LPI-Observer questionnaire, rating the leaders on the frequency with which evaluators think leaders engage in each behavior. Respondents’ feedback is anonymous. The Leader Behavior Inventory is based on five behavioral factors: Visualizing Greatness, Empowering the “We,” Communicating for Meaning, Managing One’s Self, and Care and Recognition.

Regardless of which instrument is used, public health leaders need to develop the competencies to carry out performance monitoring. They need to ensure that performance measurement is accepted by the staff and that the information gained through the monitoring process is used to improve operations. Performance measures for evaluating the activities of public health leaders and their community partners utilizing a systems perspective and the essential public health services paradigm have been developed by the National Public Health Performance Standards Program.

Why is leadership program evaluation important?

Ongoing program evaluation creates an atmosphere in which effective leadership and organizational learning can flourish. Leaders need to show support for program evaluation and include evaluation as part of the mission and vision of their agency. They need to be involved in the evaluation process and work with other agency officials to ensure that the process is successful. No organization can achieve excellence without opportunities for continual learning provided by training and leadership development programs. There are four major standards for program evaluation: utility, feasibility, propriety, and accuracy.

One of the first steps in program evaluation is to determine whether the training program is really necessary.  Once the topic of the program has been determined to be needed, the programs objectives should be set and the program developed. The third step is to offer the training program itself. Measurements should be done before or at the start of the training program and at its conclusion to determine the scope of the changes that occurred. Research can be done on several measures, including the association between program elements and leadership change, the lessons learned from the training course, measurable leadership competencies, the differences between new leaders and established ones, and the differences between trainees and colleagues who have not been trained.

What is one difficulty in evaluating leadership programs?

Because leadership development is sometimes used as a reward for public health professionals, there is a danger that this reward will benefit the individual and not the public health system if the training opportunity is not relevant to the needs of the system. Another challenge is the fact that a leadership development may not show an immediate return on investment. The delay between leadership development and the development of strategic outcomes creates difficulties in determining the value of training programs.  Another challenge is the lack of funding in public health leadership development for the evaluation function. There is also a lack of understanding about what such evaluations are supposed to accomplish.

How do leadership programs differ from other training or education programs?

Leadership development programs are different from other types of training programs because they seek to influence behaviors beyond specific skill sets. Traditional training or education programs seek to impart skills to the participants- teach them Java Script, how to better deal with conflict, or how a clinical trial can best be designed, etc. Because leadership is multidimensional and dependant on the internalization and projection of the organization’s mission and values, leadership development is much more profound than just learning a series of steps to carry out a project or handle a particular situation. 

What leadership issues do you think should be the focus of research?

I think the biggest challenge that leaders face is inspiring their employees to perform at the level of their personal best 100% of the time. Therefore studying the mechanisms whereby leaders can either inspire employees to perform at their peak level or leave the organization should be the topic of leadership research.

What are some benefits that would be gained by keeping a leadership journal?

Leadership is a complex, multi-faceted form of performance. We cannot know leadership exists unless something happens. Therefore it may be useful for the leader to keep a log of the activities and decisions she/he makes and document the outcomes of those decisions. Documenting situations and decisions over time allows a leader to look back and evaluate her evolution over time. This written record would also serve to help the leader construct case studies which could be shared with fellow leaders.

Lean Thinking in Healthcare

Use these comments on Lean Management in Your Term Paper/ Final Paper

I found the topic of lean management to be really fascinating, and think that there are many areas where this sort of efficiency thinking could be put to work.

I think that while we sing the praises of the TPS it is important to remember the Toyota recall problem that occurred in 2009-2010. Ultimately, the NTHSA found that Toyota didn’t have a manufacturing issue with their electronic throttles, but rather Toyota had a problem with lack of transparency and admitting there was a problem with their floor mats and steering columns (You can read press release here http://www.nhtsa.gov/PR/DOT-216-10) While lean thinking and the TPS may produce manufacturing efficiencies, when we are pursuing quality we may sometimes miss the mark, and organizations need to be able to admit when they have failed.

I found that the application of lean thinking in the emergency department to be especially valuable. Patients that are already admitted to the hospital may be less focused on getting out, so trying to speed up the inpatient process may be more challenging. However, patients coming to the ER (in most cases) just want to be treated and released. I found a really interesting video about lean in Great Britain  http://www.youtube.com/watch?v=tOuIrRPI9Xw where they completely re-designed their flow by having the 85% of people that will probably be released see only the receptionist and a nurse practitioner. The receptionist acted as both patient greeter and patient registrar, and the nurse practitioner replaced the triage nurse, the nurse aid that comes out to take you back to the bed and re-check your vital signs, the RN that performs the nursing assessment, and the physician that performs the physical exam and orders tests. The nurse practitioner is able to fill all of those roles, and by having the patient only interact with the NP, wait time and time spent rehearsing the history of present illness to multiple parties is reduced. Only the patients that the NP believes need admission are seen by the ER attending, and the ER attending is primarily responsible for seeing myocardial infarctions and traumas (whose treatment needs are beyond the scope of practice of the NP). An issue that management would have to consider is whether the efficiencies created counterbalance the higher salary they will pay the NP to do some work for which the NP is overqualified

There are many challenges to implementing lean management in an organization. In the aforementioned example, what happened to the jobs of all of the registrars, unit clerks, nurse aids, EKG techs, phlebotomists, and RNs that previously took care of the ER patients?  How do you have a “No Layoff Policy” while reengineering processes and positions? Another challenge that leaders face is resistance to change and negative employee attitudes. Leadership may have previously used some sort of quality or productivity tool and employees may initially see lean as a fad that leadership will eventually outgrow and hence not see the need to realign attitudes and behaviors around lean thinking.  Resistance to change is deeply ingrained in many professionals working in the healthcare field and leadership has to work hard to create buy-in and overcome the “that’s how we did it when I was in medical/nursing school” mentality.

One of the main arguments in favor of lean is that the American healthcare system is full of waste. As a society, we need to re-engineer our medical system because we cannot afford to maintain our status quo. This actually takes the idea of resistance to change to the higher level of society. Is our system wasteful only because we rely on expensive imaging technologies? Or is it also wasteful because our patient’s health literacy and ability to self-manage is insufficient? Or is it wasteful because of concern over medical malpractice causes duplicity in testing? As a people, Americans need to be willing to “trim the fat” that exists in our system; lean thinking can help health systems do this by systematically examining the root causes of problems and engineering long term solutions to solve systemic problems. 

Performance Management- Baldrige Award Winners and the Balanced Scorecard Approach

The positive aspect of the Balanced Scorecard approach is that it looks past simple financial results to the overall big picture of what is going on in the organization overall. This is especially important in businesses that are publically traded since there is a perverse incentive to take actions that “improve performance” on financial statements in the short run but in the long run jeopardize the competitive advantage and growth of the company. An example of this would be a government contracting services firm that dumps employees to reduce their immediate short term cash obligation to pay salaries, but later finds itself unable to bid competitively on new service contracts because they lack the people with skill sets to fulfill the contracts. Under the balanced scorecard, leadership should consider the customers perspective, the financial perspective, the internal business perspective, and the innovation and learning perspective.

The customer’s perspective has to do with how the external public (customer) views the company. An example would be how people view their iPad in comparison to how people view their Dell Streak. If you are Apple, your relationship with iPad users is going well; if you are Dell, your relationship with Streak owners is pretty dispassionate. The status of the relationship with the customer is essential when considering the future of a business. Just as the current status of a marriage relationship can tell us about the future of that marriage relationship, the current status of the company’s relationship with their customer base can be useful in predicting the probable future status.

However, current reality is not 100% predictive of future reality. This is why it is important for companies to consider innovation and learning perspective. Just as people grow and change over time, products and services demanded by the market grow and change over time. To know if the relationship with the customer will last over time, companies must proactively seek out new knowledge and trends. In terms of competitive advantage, companies should strive to be a market leader instead of a market follower in order to achieve maximum financial results. An example of this is Apple. People didn’t know they needed the iPhone until after Apple shared this information with them. All the other companies that produced similar products after Apple could only compete on price, since their product was not considered innovative by the market.

Financial reality is still important, however. Only through adequate cash flow and profitability can the business continue to exist and respond to its internal and external publics. The internal business perspective is critical in evaluating overall business performance. A company such as Starbucks is selling a product, but it could also be argued that they are also selling an experience. Part of that experience is the customer’s interaction with the staff. If companies are not adequately investing in their employees through wages, benefits, training, and the creation of a positive work environment, it is probable that employees will become resentful over time and seek out alternant employment options. For a services or knowledge based company, it is ESSENTIAL that the internal perspective of employee relationship management is prioritized. If the company is more a manufacturing type of firm, the internal business perspective may emphasize productivity or manufacturing excellence.

Since the creation of the managed score card requires data, and data must be generated and organized, it would be good if healthcare entities had a way to integrate external quality measures (from Medicare and the Joint Commission National Patient Safety Goals) in their internal management and processes. I looked at Poudre Valley Health Systems, AlantiCare, and Mercy Health System’s performance measure on their Baldridge applications. One thing I found across the board was that they all commented on how they assure data integrity, security, and HIPPA compliance. The timeliness of the data collection and review are necessary in order for the information to be actionable. By reviewing performance on a frequent basis, health entities can take corrective action to address areas where they are not performing at an adequate level.