US Dermatology Residency Program Rankings

Many hospital-based adult specialties are routinely ranked annually by US News & World Report. Its 2014-2015 rankings included cancer; cardiology and heart surgery; diabetes and endocrinology; ear, nose, and throat; gastroenterology and gastrointestinal surgery; geriatrics; gynecology; nephrology; neurology and neurosurgery; ophthalmology; orthopedics; pulmonology; psychiatry; rehabilitation; rheumatology; and urology.¹ Only teaching hospitals that saw a high volume of patients were included in the rankings. Ophthalmology, psychiatry, rehabilitation, and rheumatology were ranked based on reputation among specialists; the others were ranked based on objective data (eg, hospital mortality rates, nursing ratios) in addition to a reputation score from a survey of physicians.¹

Dermatology has never been included in the annual US News & World Report rankings. In the past, dermatology residency programs have been ranked solely according to the amount of annual funding received from the National Institutes of Health (NIH).² Wu et al³ expanded the scope by creating an algorithm used to rank dermatology residency programs based on scholarly achievement. Included were a number of NIH grants as well as 4 other factors—publications in 2001-2004, Dermatology Foundation (DF) grants from 2001-2004, faculty lectures in 2004 delivered at national conferences, and number of full-time faculty members who were on the editorial boards of the top 3 US dermatology journals and the top 4 subspecialty journals—deemed important by the authors.³

The current study refines the prior algorithm by creating a weighted ranking algorithm and using criteria that the authors considered to be more meaningful than the original criteria used.³ Specifically, the current study considered the amount of NIH and DF funding received versus the number of grants received, and less importance was given to the number of faculty members on editorial boards and DF funding relative to other criteria. We used publicly available data from Web searches to conduct this study.

Methods

The overall ranking algorithm was designed based on the methodology used by the Institute of Higher Education, Shanghai Jiao Tong University, to rank universities in the annual Academic Ranking of World Universities, which is published annually and uses a weighted ranking algorithm that includes academic and research performance factors to evaluate universities worldwide.⁴

The names of all dermatology residency programs in the United States were obtained as of December 31, 2008, from FREIDA Online using the search term dermatology; the names of all full-time faculty members at these residency programs and number of residents also were obtained by searching the programs’ Web sites.

For another related study investigating the relationship between residency program characteristics and residents pursuing a career in dermatology, the following data were obtained: total number of full-time faculty members at the program; total number of residents; amount of NIH funding received in 2008 (http://report.nih.gov/award/index.cfm); amount of DF funding received in 2008 (http://dermatologyfoundation.org/pdf/pubs/DF_2008_Annual_Report.pdf.); number of publications by full-time faculty members in 2008 (http://www.ncbi.nlm.nih.gov/pubmed/); number of faculty lectures given at annual meetings of 5 societies in 2008 (American Academy of Dermatology, the Society for Investigative Dermatology, the American Society of Dermatopathology, the Society for Pediatric Dermatology, and the American Society for Dermatologic Surgery); the number of full-time faculty members who were on the editorial boards of 6 dermatology journals (Journal of Investigative Dermatology, Archives of Dermatology [currently known as JAMA Dermatology], Journal of the American Academy of Dermatology, Dermatologic Surgery, Journal of Cutaneous Pathology, and Pediatric Dermatology); and whether a program was housed within an institution’s department of dermatology or division of internal medicine.

The data were summed for all faculty members at a given program. To avoid duplicate faculty publications, collections for each residency program were created within PubMed (ie, if 2 authors from the same program coauthored an article, it was only counted once toward the total number of faculty publications from that program).

The dermatology residency programs that were excluded from this analysis included University of Texas at Austin, University of Texas Medical Branch, and the University of Connecticut, which were started in 2008, as well as Kaiser Permanente Southern California, which was started in 2010. The combined Boston University and Tufts University dermatology residency program was established prior to 2008 and therefore was counted as such in the analysis. The program at Harbor-UCLA Medical Center was not included in the analysis because the program was reestablished in 2004 and we could not assume that the prior program had similar attributes. Military residency programs also were excluded from the analysis, as residents are assigned to faculty positions upon graduation. The NIH residency program also was excluded because it is not a traditional 3-year residency program.

There were 5 factors that were deemed by the authors to be the most reflective of academic achievement among dermatology residency programs: number of faculty publications in 2008; amount of NIH funding received in 2008; number of faculty lectures given at 5 society meetings in 2008; amount of DF funding received in 2008; and the number of faculty members who were on the editorial boards of 6 dermatology journals in 2008. We wished to get a broad range of subspecialties of dermatology (eg, medical, surgical) for the journals. Further, the 6 journals selected were chosen because they had the highest impact factors at the time for general dermatology and dermatopathology.

Each residency program was assigned a score from 0 to 1 for each of these factors. The program with the highest number of faculty publications was assigned a score of 1 and the program with the lowest number of publications was assigned a score of 0. The programs in between were subsequently assigned scores from 0 to 1 based on the number of publications as a percentage of the number of publications from the program with the most publications.

A weighted ranking scheme was used to rank programs based on the relative importance of each factor. The authors decided that NIH funding, number of faculty publications, and number of lectures at society meetings were relatively more important than the other factors; thus these factors were given a weight of 1.0. The remaining factors—DF funding and number of faculty members on editorial boards of journals—were given a weight of 0.5. Values were totaled and programs were ranked based on the sum of these values.

Data were analyzed using SAS 9.2 software. This study was approved by the institutional review board at Kaiser Permanente Southern California.

Results

The overall ranking of the top 20 US dermatology residency programs in 2008 is presented in Table 1. The top 5 programs based on each of the 5 factors used in the weighted ranking algorithm are presented in Tables 2 through 6.

A separate analysis was performed to evaluate the relationship between the ranking factors and the size of the residency programs, as the data seemed to favor larger programs. Table 7 demonstrates that the amount of NIH and DF funding was positively correlated with the number of faculty members in a residency program. The remaining factors were not correlated with the number of faculty in the program.

Due to space considerations, analyses are based on data not shown in this manuscript. Data about the characteristics of each residency program are available from the authors.

Comment

There previously have been few attempts to rank US dermatology residency programs based on factors related to academic achievement. Individual faculty and programs have been ranked based on the number of publications in the literature.^5-7 Dermatology institutions/organizations (eg, departments, hospitals, medical schools) have been ranked based on amount of NIH funding received and number of journal citations.⁸

Dermatology residency programs have been ranked based on amount of NIH funding received annually.² Based on the prior Wu et al³ ranking algorithm for 2004 data, the institutions with the top 5 residency programs were the University of Pennsylvania, University of California, San Francisco; Yale University; New York University; and the University of Michigan.

The current study refined this ranking algorithm by including residency programs housed within the institution’s division of dermatology of a department of internal medicine, which were previously excluded from NIH funding data, as opposed to just the department of dermatology. The authors also did not count publications coauthored by faculty members at the same institution more than once. The annual amount of DF funding received was considered rather than number of grants, as this factor was thought to better reflect the scale of research being conducted. Additionally, relatively more weight was given to annual NIH funding, annual number of faculty publications, and number of faculty lectures at annual society meetings than to annual amount of DF funding and number of faculty on journal editorial boards. The University of Pennsylvania; the University of California, San Francisco; and Yale University were in the top 5 based on data from 2004 in the prior study³ and 2008 in the current study.

Distribution of grant funding and number of faculty publications in the literature often are used as a measure of scholarly achievement. Within the specialty of dermatology, the amount of NIH and DF funding received could be considered the most prestigious achievement for a residency program. Faculty members are encouraged to develop expertise in a specialized area of dermatology as well as to conduct research and publish articles in the area of their choosing. One of the most common ways to attain tenure and achieve academic recognition is by publishing articles in peer-reviewed journals with high impact factors. Other factors that demonstrate expertise and accomplishment in one’s field include giving lectures at national society meetings and sitting on editorial boards of prestigious journals.

The authors deemed these factors to be the most reflective of academic achievement in a dermatology residency program. It should come as no surprise that the top programs according to our algorithm generally are regarded as the most prestigious programs in the country.

The current study did have some limitations. For instance, residency programs were ranked solely based on academic achievements. Although academic achievement is an important aspect of the reputation of a dermatology residency program, it does not account for other important aspects of a program such as commitment to teaching and patient care. These aspects are difficult to measure and were not included in our ranking algorithm. For this reason, there are many excellent residency programs that may not be listed in this article as top programs but still provide outstanding clinical training and patient care. Our ranking algorithm is more indicative of a program’s commitment to research and scholarship and does not necessarily reflect how well a program trains its residents.

The factors included in our ranking algorithm also were somewhat arbitrary. The 5 factors that were chosen by the authors were considered to be most reflective of academic achievement and also will be easy to obtain in future years to replicate these rankings; however, there are other important factors that could have been used instead or in addition to the factors we chose. Some of the chosen factors were more important than others, so a decision was made to weight the factors. In-training examination scores from the American Board of Dermatology, boards passing rate, or percentage of residents who received fellowships or academic appointments were not used because this information is not publicly available. The current study also appeared to favor larger residency programs. Programs with fewer faculty members generally receive less research funding and have fewer publications, fewer faculty members on journal editorial boards, and fewer lecturers at national society meetings. This factor was not controlled for in the original analysis, as larger programs generally are thought to be more prestigious; therefore, this bias should be accounted for in the rankings.

Conclusion

Based on our weighted ranking algorithm, the top 5 dermatology residency programs in 2008 were University of California, San Francisco; Northwestern University; University of Pennsylvania; Yale University; and Stanford University.

Acknowledgements—We thank all of the program coordinators, full-time faculty members, program directors, chairs, and chiefs who were kind enough to field our questions if we had any missing data about their programs. We thank Mary H. Black, PhD, Pasadena, California, for her contribution to the analytical plan.

Many hospital-based adult specialties are routinely ranked annually by US News & World Report. Its 2014-2015 rankings included cancer; cardiology and heart surgery; diabetes and endocrinology; ear, nose, and throat; gastroenterology and gastrointestinal surgery; geriatrics; gynecology; nephrology; neurology and neurosurgery; ophthalmology; orthopedics; pulmonology; psychiatry; rehabilitation; rheumatology; and urology.¹ Only teaching hospitals that saw a high volume of patients were included in the rankings. Ophthalmology, psychiatry, rehabilitation, and rheumatology were ranked based on reputation among specialists; the others were ranked based on objective data (eg, hospital mortality rates, nursing ratios) in addition to a reputation score from a survey of physicians.¹

Dermatology has never been included in the annual US News & World Report rankings. In the past, dermatology residency programs have been ranked solely according to the amount of annual funding received from the National Institutes of Health (NIH).² Wu et al³ expanded the scope by creating an algorithm used to rank dermatology residency programs based on scholarly achievement. Included were a number of NIH grants as well as 4 other factors—publications in 2001-2004, Dermatology Foundation (DF) grants from 2001-2004, faculty lectures in 2004 delivered at national conferences, and number of full-time faculty members who were on the editorial boards of the top 3 US dermatology journals and the top 4 subspecialty journals—deemed important by the authors.³

The current study refines the prior algorithm by creating a weighted ranking algorithm and using criteria that the authors considered to be more meaningful than the original criteria used.³ Specifically, the current study considered the amount of NIH and DF funding received versus the number of grants received, and less importance was given to the number of faculty members on editorial boards and DF funding relative to other criteria. We used publicly available data from Web searches to conduct this study.

Methods

The overall ranking algorithm was designed based on the methodology used by the Institute of Higher Education, Shanghai Jiao Tong University, to rank universities in the annual Academic Ranking of World Universities, which is published annually and uses a weighted ranking algorithm that includes academic and research performance factors to evaluate universities worldwide.⁴

The names of all dermatology residency programs in the United States were obtained as of December 31, 2008, from FREIDA Online using the search term dermatology; the names of all full-time faculty members at these residency programs and number of residents also were obtained by searching the programs’ Web sites.

For another related study investigating the relationship between residency program characteristics and residents pursuing a career in dermatology, the following data were obtained: total number of full-time faculty members at the program; total number of residents; amount of NIH funding received in 2008 (http://report.nih.gov/award/index.cfm); amount of DF funding received in 2008 (http://dermatologyfoundation.org/pdf/pubs/DF_2008_Annual_Report.pdf.); number of publications by full-time faculty members in 2008 (http://www.ncbi.nlm.nih.gov/pubmed/); number of faculty lectures given at annual meetings of 5 societies in 2008 (American Academy of Dermatology, the Society for Investigative Dermatology, the American Society of Dermatopathology, the Society for Pediatric Dermatology, and the American Society for Dermatologic Surgery); the number of full-time faculty members who were on the editorial boards of 6 dermatology journals (Journal of Investigative Dermatology, Archives of Dermatology [currently known as JAMA Dermatology], Journal of the American Academy of Dermatology, Dermatologic Surgery, Journal of Cutaneous Pathology, and Pediatric Dermatology); and whether a program was housed within an institution’s department of dermatology or division of internal medicine.

The data were summed for all faculty members at a given program. To avoid duplicate faculty publications, collections for each residency program were created within PubMed (ie, if 2 authors from the same program coauthored an article, it was only counted once toward the total number of faculty publications from that program).

The dermatology residency programs that were excluded from this analysis included University of Texas at Austin, University of Texas Medical Branch, and the University of Connecticut, which were started in 2008, as well as Kaiser Permanente Southern California, which was started in 2010. The combined Boston University and Tufts University dermatology residency program was established prior to 2008 and therefore was counted as such in the analysis. The program at Harbor-UCLA Medical Center was not included in the analysis because the program was reestablished in 2004 and we could not assume that the prior program had similar attributes. Military residency programs also were excluded from the analysis, as residents are assigned to faculty positions upon graduation. The NIH residency program also was excluded because it is not a traditional 3-year residency program.

There were 5 factors that were deemed by the authors to be the most reflective of academic achievement among dermatology residency programs: number of faculty publications in 2008; amount of NIH funding received in 2008; number of faculty lectures given at 5 society meetings in 2008; amount of DF funding received in 2008; and the number of faculty members who were on the editorial boards of 6 dermatology journals in 2008. We wished to get a broad range of subspecialties of dermatology (eg, medical, surgical) for the journals. Further, the 6 journals selected were chosen because they had the highest impact factors at the time for general dermatology and dermatopathology.

Each residency program was assigned a score from 0 to 1 for each of these factors. The program with the highest number of faculty publications was assigned a score of 1 and the program with the lowest number of publications was assigned a score of 0. The programs in between were subsequently assigned scores from 0 to 1 based on the number of publications as a percentage of the number of publications from the program with the most publications.

A weighted ranking scheme was used to rank programs based on the relative importance of each factor. The authors decided that NIH funding, number of faculty publications, and number of lectures at society meetings were relatively more important than the other factors; thus these factors were given a weight of 1.0. The remaining factors—DF funding and number of faculty members on editorial boards of journals—were given a weight of 0.5. Values were totaled and programs were ranked based on the sum of these values.

Data were analyzed using SAS 9.2 software. This study was approved by the institutional review board at Kaiser Permanente Southern California.

Results

The overall ranking of the top 20 US dermatology residency programs in 2008 is presented in Table 1. The top 5 programs based on each of the 5 factors used in the weighted ranking algorithm are presented in Tables 2 through 6.

A separate analysis was performed to evaluate the relationship between the ranking factors and the size of the residency programs, as the data seemed to favor larger programs. Table 7 demonstrates that the amount of NIH and DF funding was positively correlated with the number of faculty members in a residency program. The remaining factors were not correlated with the number of faculty in the program.

Due to space considerations, analyses are based on data not shown in this manuscript. Data about the characteristics of each residency program are available from the authors.

Comment

There previously have been few attempts to rank US dermatology residency programs based on factors related to academic achievement. Individual faculty and programs have been ranked based on the number of publications in the literature.^5-7 Dermatology institutions/organizations (eg, departments, hospitals, medical schools) have been ranked based on amount of NIH funding received and number of journal citations.⁸

Dermatology residency programs have been ranked based on amount of NIH funding received annually.² Based on the prior Wu et al³ ranking algorithm for 2004 data, the institutions with the top 5 residency programs were the University of Pennsylvania, University of California, San Francisco; Yale University; New York University; and the University of Michigan.

The current study refined this ranking algorithm by including residency programs housed within the institution’s division of dermatology of a department of internal medicine, which were previously excluded from NIH funding data, as opposed to just the department of dermatology. The authors also did not count publications coauthored by faculty members at the same institution more than once. The annual amount of DF funding received was considered rather than number of grants, as this factor was thought to better reflect the scale of research being conducted. Additionally, relatively more weight was given to annual NIH funding, annual number of faculty publications, and number of faculty lectures at annual society meetings than to annual amount of DF funding and number of faculty on journal editorial boards. The University of Pennsylvania; the University of California, San Francisco; and Yale University were in the top 5 based on data from 2004 in the prior study³ and 2008 in the current study.

Distribution of grant funding and number of faculty publications in the literature often are used as a measure of scholarly achievement. Within the specialty of dermatology, the amount of NIH and DF funding received could be considered the most prestigious achievement for a residency program. Faculty members are encouraged to develop expertise in a specialized area of dermatology as well as to conduct research and publish articles in the area of their choosing. One of the most common ways to attain tenure and achieve academic recognition is by publishing articles in peer-reviewed journals with high impact factors. Other factors that demonstrate expertise and accomplishment in one’s field include giving lectures at national society meetings and sitting on editorial boards of prestigious journals.

The authors deemed these factors to be the most reflective of academic achievement in a dermatology residency program. It should come as no surprise that the top programs according to our algorithm generally are regarded as the most prestigious programs in the country.

The current study did have some limitations. For instance, residency programs were ranked solely based on academic achievements. Although academic achievement is an important aspect of the reputation of a dermatology residency program, it does not account for other important aspects of a program such as commitment to teaching and patient care. These aspects are difficult to measure and were not included in our ranking algorithm. For this reason, there are many excellent residency programs that may not be listed in this article as top programs but still provide outstanding clinical training and patient care. Our ranking algorithm is more indicative of a program’s commitment to research and scholarship and does not necessarily reflect how well a program trains its residents.

The factors included in our ranking algorithm also were somewhat arbitrary. The 5 factors that were chosen by the authors were considered to be most reflective of academic achievement and also will be easy to obtain in future years to replicate these rankings; however, there are other important factors that could have been used instead or in addition to the factors we chose. Some of the chosen factors were more important than others, so a decision was made to weight the factors. In-training examination scores from the American Board of Dermatology, boards passing rate, or percentage of residents who received fellowships or academic appointments were not used because this information is not publicly available. The current study also appeared to favor larger residency programs. Programs with fewer faculty members generally receive less research funding and have fewer publications, fewer faculty members on journal editorial boards, and fewer lecturers at national society meetings. This factor was not controlled for in the original analysis, as larger programs generally are thought to be more prestigious; therefore, this bias should be accounted for in the rankings.

Conclusion

Based on our weighted ranking algorithm, the top 5 dermatology residency programs in 2008 were University of California, San Francisco; Northwestern University; University of Pennsylvania; Yale University; and Stanford University.

Acknowledgements—We thank all of the program coordinators, full-time faculty members, program directors, chairs, and chiefs who were kind enough to field our questions if we had any missing data about their programs. We thank Mary H. Black, PhD, Pasadena, California, for her contribution to the analytical plan.

Many hospital-based adult specialties are routinely ranked annually by US News & World Report. Its 2014-2015 rankings included cancer; cardiology and heart surgery; diabetes and endocrinology; ear, nose, and throat; gastroenterology and gastrointestinal surgery; geriatrics; gynecology; nephrology; neurology and neurosurgery; ophthalmology; orthopedics; pulmonology; psychiatry; rehabilitation; rheumatology; and urology.¹ Only teaching hospitals that saw a high volume of patients were included in the rankings. Ophthalmology, psychiatry, rehabilitation, and rheumatology were ranked based on reputation among specialists; the others were ranked based on objective data (eg, hospital mortality rates, nursing ratios) in addition to a reputation score from a survey of physicians.¹

Dermatology has never been included in the annual US News & World Report rankings. In the past, dermatology residency programs have been ranked solely according to the amount of annual funding received from the National Institutes of Health (NIH).² Wu et al³ expanded the scope by creating an algorithm used to rank dermatology residency programs based on scholarly achievement. Included were a number of NIH grants as well as 4 other factors—publications in 2001-2004, Dermatology Foundation (DF) grants from 2001-2004, faculty lectures in 2004 delivered at national conferences, and number of full-time faculty members who were on the editorial boards of the top 3 US dermatology journals and the top 4 subspecialty journals—deemed important by the authors.³

The current study refines the prior algorithm by creating a weighted ranking algorithm and using criteria that the authors considered to be more meaningful than the original criteria used.³ Specifically, the current study considered the amount of NIH and DF funding received versus the number of grants received, and less importance was given to the number of faculty members on editorial boards and DF funding relative to other criteria. We used publicly available data from Web searches to conduct this study.

Methods

The overall ranking algorithm was designed based on the methodology used by the Institute of Higher Education, Shanghai Jiao Tong University, to rank universities in the annual Academic Ranking of World Universities, which is published annually and uses a weighted ranking algorithm that includes academic and research performance factors to evaluate universities worldwide.⁴

The names of all dermatology residency programs in the United States were obtained as of December 31, 2008, from FREIDA Online using the search term dermatology; the names of all full-time faculty members at these residency programs and number of residents also were obtained by searching the programs’ Web sites.

For another related study investigating the relationship between residency program characteristics and residents pursuing a career in dermatology, the following data were obtained: total number of full-time faculty members at the program; total number of residents; amount of NIH funding received in 2008 (http://report.nih.gov/award/index.cfm); amount of DF funding received in 2008 (http://dermatologyfoundation.org/pdf/pubs/DF_2008_Annual_Report.pdf.); number of publications by full-time faculty members in 2008 (http://www.ncbi.nlm.nih.gov/pubmed/); number of faculty lectures given at annual meetings of 5 societies in 2008 (American Academy of Dermatology, the Society for Investigative Dermatology, the American Society of Dermatopathology, the Society for Pediatric Dermatology, and the American Society for Dermatologic Surgery); the number of full-time faculty members who were on the editorial boards of 6 dermatology journals (Journal of Investigative Dermatology, Archives of Dermatology [currently known as JAMA Dermatology], Journal of the American Academy of Dermatology, Dermatologic Surgery, Journal of Cutaneous Pathology, and Pediatric Dermatology); and whether a program was housed within an institution’s department of dermatology or division of internal medicine.

The data were summed for all faculty members at a given program. To avoid duplicate faculty publications, collections for each residency program were created within PubMed (ie, if 2 authors from the same program coauthored an article, it was only counted once toward the total number of faculty publications from that program).

The dermatology residency programs that were excluded from this analysis included University of Texas at Austin, University of Texas Medical Branch, and the University of Connecticut, which were started in 2008, as well as Kaiser Permanente Southern California, which was started in 2010. The combined Boston University and Tufts University dermatology residency program was established prior to 2008 and therefore was counted as such in the analysis. The program at Harbor-UCLA Medical Center was not included in the analysis because the program was reestablished in 2004 and we could not assume that the prior program had similar attributes. Military residency programs also were excluded from the analysis, as residents are assigned to faculty positions upon graduation. The NIH residency program also was excluded because it is not a traditional 3-year residency program.

There were 5 factors that were deemed by the authors to be the most reflective of academic achievement among dermatology residency programs: number of faculty publications in 2008; amount of NIH funding received in 2008; number of faculty lectures given at 5 society meetings in 2008; amount of DF funding received in 2008; and the number of faculty members who were on the editorial boards of 6 dermatology journals in 2008. We wished to get a broad range of subspecialties of dermatology (eg, medical, surgical) for the journals. Further, the 6 journals selected were chosen because they had the highest impact factors at the time for general dermatology and dermatopathology.

Each residency program was assigned a score from 0 to 1 for each of these factors. The program with the highest number of faculty publications was assigned a score of 1 and the program with the lowest number of publications was assigned a score of 0. The programs in between were subsequently assigned scores from 0 to 1 based on the number of publications as a percentage of the number of publications from the program with the most publications.

A weighted ranking scheme was used to rank programs based on the relative importance of each factor. The authors decided that NIH funding, number of faculty publications, and number of lectures at society meetings were relatively more important than the other factors; thus these factors were given a weight of 1.0. The remaining factors—DF funding and number of faculty members on editorial boards of journals—were given a weight of 0.5. Values were totaled and programs were ranked based on the sum of these values.

Data were analyzed using SAS 9.2 software. This study was approved by the institutional review board at Kaiser Permanente Southern California.

Results

The overall ranking of the top 20 US dermatology residency programs in 2008 is presented in Table 1. The top 5 programs based on each of the 5 factors used in the weighted ranking algorithm are presented in Tables 2 through 6.

A separate analysis was performed to evaluate the relationship between the ranking factors and the size of the residency programs, as the data seemed to favor larger programs. Table 7 demonstrates that the amount of NIH and DF funding was positively correlated with the number of faculty members in a residency program. The remaining factors were not correlated with the number of faculty in the program.

Due to space considerations, analyses are based on data not shown in this manuscript. Data about the characteristics of each residency program are available from the authors.

Comment

There previously have been few attempts to rank US dermatology residency programs based on factors related to academic achievement. Individual faculty and programs have been ranked based on the number of publications in the literature.^5-7 Dermatology institutions/organizations (eg, departments, hospitals, medical schools) have been ranked based on amount of NIH funding received and number of journal citations.⁸

Dermatology residency programs have been ranked based on amount of NIH funding received annually.² Based on the prior Wu et al³ ranking algorithm for 2004 data, the institutions with the top 5 residency programs were the University of Pennsylvania, University of California, San Francisco; Yale University; New York University; and the University of Michigan.

The current study refined this ranking algorithm by including residency programs housed within the institution’s division of dermatology of a department of internal medicine, which were previously excluded from NIH funding data, as opposed to just the department of dermatology. The authors also did not count publications coauthored by faculty members at the same institution more than once. The annual amount of DF funding received was considered rather than number of grants, as this factor was thought to better reflect the scale of research being conducted. Additionally, relatively more weight was given to annual NIH funding, annual number of faculty publications, and number of faculty lectures at annual society meetings than to annual amount of DF funding and number of faculty on journal editorial boards. The University of Pennsylvania; the University of California, San Francisco; and Yale University were in the top 5 based on data from 2004 in the prior study³ and 2008 in the current study.

Distribution of grant funding and number of faculty publications in the literature often are used as a measure of scholarly achievement. Within the specialty of dermatology, the amount of NIH and DF funding received could be considered the most prestigious achievement for a residency program. Faculty members are encouraged to develop expertise in a specialized area of dermatology as well as to conduct research and publish articles in the area of their choosing. One of the most common ways to attain tenure and achieve academic recognition is by publishing articles in peer-reviewed journals with high impact factors. Other factors that demonstrate expertise and accomplishment in one’s field include giving lectures at national society meetings and sitting on editorial boards of prestigious journals.

The authors deemed these factors to be the most reflective of academic achievement in a dermatology residency program. It should come as no surprise that the top programs according to our algorithm generally are regarded as the most prestigious programs in the country.

The current study did have some limitations. For instance, residency programs were ranked solely based on academic achievements. Although academic achievement is an important aspect of the reputation of a dermatology residency program, it does not account for other important aspects of a program such as commitment to teaching and patient care. These aspects are difficult to measure and were not included in our ranking algorithm. For this reason, there are many excellent residency programs that may not be listed in this article as top programs but still provide outstanding clinical training and patient care. Our ranking algorithm is more indicative of a program’s commitment to research and scholarship and does not necessarily reflect how well a program trains its residents.

The factors included in our ranking algorithm also were somewhat arbitrary. The 5 factors that were chosen by the authors were considered to be most reflective of academic achievement and also will be easy to obtain in future years to replicate these rankings; however, there are other important factors that could have been used instead or in addition to the factors we chose. Some of the chosen factors were more important than others, so a decision was made to weight the factors. In-training examination scores from the American Board of Dermatology, boards passing rate, or percentage of residents who received fellowships or academic appointments were not used because this information is not publicly available. The current study also appeared to favor larger residency programs. Programs with fewer faculty members generally receive less research funding and have fewer publications, fewer faculty members on journal editorial boards, and fewer lecturers at national society meetings. This factor was not controlled for in the original analysis, as larger programs generally are thought to be more prestigious; therefore, this bias should be accounted for in the rankings.

Conclusion

Based on our weighted ranking algorithm, the top 5 dermatology residency programs in 2008 were University of California, San Francisco; Northwestern University; University of Pennsylvania; Yale University; and Stanford University.

Acknowledgements—We thank all of the program coordinators, full-time faculty members, program directors, chairs, and chiefs who were kind enough to field our questions if we had any missing data about their programs. We thank Mary H. Black, PhD, Pasadena, California, for her contribution to the analytical plan.