Article Type
Changed
Mon, 01/14/2019 - 11:11
Display Headline
The Technical Performance and Clinical Feasibility of Telecolposcopy

 

BACKGROUND: The purpose of our study was to demonstrate the technical performance and clinical feasibility of a telecolposcopic system through assessment of image transmission veracity, ease of office system implementation, and the patient’s acceptance of the electronic image transmission.

METHODS: We used a telecolposcopic system incorporating a custom software package that integrated patient history, current gynecologic status, epidemiologic risk factors, and colposcopic images for local medical documentation and transmission. Satisfaction questionnaires were developed to measure ease of implementation at the remote sites and the patients’ acceptance of telecolposcopy.

RESULTS: Seventy-nine women participated in our trial. From 3 to 20 images were captured for each woman, documenting cervical squamous intraepithelial lesions and vaginal and vulvar diseases. All images were received without distortions in color, size, or orientation. With complete visualization of the squamocolumnar junction there was an 86% agreement between the remote and review sites (k=.533, P=.019). The interobserver agreement for colposcopic impressions was 86% (k=.684, P <.001), and for colposcopic impressions with histology within one level of disease severity,86%(k=.78,P<.001).Col-poscopists’ and patients’ satisfaction with telecolposcopy was excellent. More than 95% of the women stated that they would rather have their colposcopy locally with electronic transmission if an experienced colposcopist were more than 25 miles away.

CONCLUSIONS: The telecolposcopic system described in our study is technically feasible, can be implemented in an office system with limited technical support, and is preferred by women who have to travel many miles to receive referral health care.

The goal of colposcopy is to identify women with high-grade disease through appropriately targeted biopsy and to correlate the cytologic-colposcopic-histologic results into a cohesive and appropriate management strategy. Approximately 80% of gynecologists and 10% of family physicians in New Hampshire currently provide access to colposcopy. These physicians have a desire to network to improve their colposcopic accuracy.1 Little work has been published either to define adequate access to colposcopy for any population of women or to improve colposcopic accuracy. Active maintenance and improvement of colposcopic skills are important, because they deteriorate after initial training. Several studies have reported lower than 50% sensitivity for detecting the quadrant of the cervix where the cervical intraepithelial neoplasia (CIN) is present.2-4 “See and treat” electrosurgical loop excision procedures have resulted in up to 50% of the specimens being histologically normal.5-9 These high rates of inaccuracy happen because of colposcopists’ inability to distinguish normal from abnormal cervical tissue. Without a dedicated desire to maintain and improve their skills, colposcopists may inadvertently overtreat women on the pretext of preventing cervical cancer.

One potential method for improving colposcopic recognition skills is the development of a network of telecolposcopists who share patient histories, colposcopic images, and histology correlations on a routine basis. Before determining whether this network would improve colposcopic care, it must first be shown that telecolposcopic images can be transmitted to and recognized accurately at the reception site.

Radiologists, dermatologists, pathologists, and psychiatrists10-13 have accurately relayed image transmissions. The fields of otorhinolaryngology, ophthalmology, cardiology, pulmonology, and emergency medicine have also reported telemedicine capabilities during the past few years. Teleobstetrics has demonstrated the feasibility of remote fetal ultrasonography and home monitoring of uterine activity accurately portraying fetal anomalies and uterine contractility.14-17 Colposcopy provides similar visual information about a woman’s gynecologic health. The parameters for successful telemedical image interpretation have been established for these other fields by studying the correlation between the telemedicine image and the conventional diagnostic modality.11-13,18-23

The purpose of our project was to demonstrate the technical performance and clinical feasibility of a low-end telecolposcopic system in a rural mountainous environment. Our primary goal was to determine if the transmission of colposcopic images was technically feasible and would be accurately received in an environment where the ground terrain prohibits radio wave and some satellite transmissions. Our secondary goals were to determine whether the telecolposcopy system could be incorporated into a busy medical office with minimal disruption and to determine how it affects the woman’s perceptions of the colposcopic examination. We included several questions to determine how far each woman was willing to travel to see the expert in person rather than participate in telecolposcopy.

Methods

The Review and Remote Site Selection

The review site was based at the Dartmouth Hitchcock Medical Center (DHMC), where an experienced colposcopist reviewed all images. Two remote sites were chosen for this feasibility study: The first site was a single-physician practice located in rural New Hampshire; the second site was an urban residency training clinic remote from DHMC.*

The telecolposcopic system was designed to maximize the quality of digitized images viewed during the examination and deliver those images electronically to the review center. The computer system was installed by the computer support personnel at each remote site in less than 2 hours, and included a brief introduction to the software and 3 to 5 trial runs with mock patients. Computer support personnel visited both sites one additional time during the study to answer software, hardware, and transmission questions. Our study received approval from the Committee on Protection of Human Subjects from Dartmouth Medical School.

 

 

A provider survey was designed to document the learning curve of the computer-based digital colposcopic system in an office with limited computer support available (site 1). A 23-question patient satisfaction survey was administered in 2 parts to assess the acceptability of telecolposcopy to women undergoing a colposcopic examination.

Implementation of the Telecolposcopic System

Any woman 18 years or older and scheduled for colposcopy was eligible for enrollment in the study between October 1997 and May 1998. There were no other inclusion or exclusion criteria. After consent was obtained, the woman was given patient education materials to read and asked to complete the first part of the survey. The colposcopic examination was completed as usual, except that images were focused and captured throughout the examination to document the visualization of the entire squamocolumnar junction (SCJ), transformation zone, and any visible lesions in the anogenital area. The colposcopist entered a follow-up plan in the computerized patient record. The images and history were then printed for the patient’s chart. The patient was asked to complete the second part of the satisfaction questionnaire before dismissal, and the physician was asked to complete the provider satisfaction questionnaire. The woman’s cytology and histology results were processed and read by the site’s routine pathology laboratory and were entered into the study database. The review site colposcopist was blinded to the primary colposcopist’s impressions, the woman’s cytology and histology, and any information on the questionnaires.

Statistical Analysis

Our study has a 90% power to determine a statistically significant k correlation, at the 0.05 2-tailed level, between the remote and review site colposcopists’ identification of the SCJ and their impressions of lesion severity and between each colposcopist’s impression and pathology. We used k correlation, independent and paired t tests, and descriptive statistics in this study. All statistics were calculated with Statistica (StatSoft, Tulsa, Oklahoma).24

Results

A total of 79 women participated in our study. Sites 1 and 2 captured images of 39 and 40 women, respectively, representing 100% of the women scheduled for colposcopy at each site during the study. All women were white and ranged in age from 18 to 57 years, with a mean age of 29.5 years (standard deviation=11.5). Thirty-five percent of the women received their colposcopy at their usual site of gynecologic health care; the others were referred from outside offices where colposcopy was not available. The [Table] shows the descriptive data of the women participating in the project: 79% had a history of previous abnormal anogenital lesions; 65% presented with either atypical squamous cells of undetermined significance or low-grade squamous intraepithelial lesion (LSIL) cytology, and approximately 20% had a CIN 2/3 lesion histologically.

Technical Feasibility

The number of images captured for each patient varied from 3 to 20, and the details of the patient’s gynecologic history varied from the current visit data to an extensive past medical and gynecologic history. The average time for transmission of one patient’s images was 6 minutes.

Technical feasibility was measured by the percentage of agreement between the review and both remote sites for colposcopic impressions and histology correlates. A k value greater than 0.75 denotes excellent agreement, between 0.4 and 0.75 is good agreement, and below 0.4 is marginal agreement.25 For all examinations, the physician at the remote sites attempted to capture the SCJ for transmission. The SCJ was noted as “completely visualized” or “not visualized.” There was 86% agreement in complete visualization of the SCJ between the review and the remote sites (k=.533; 95% confidence interval [CI], 0.276-0.791; P=.019).

Both remote and review site physicians classified the colposcopic cervical impression as normal, LSIL, or high-grade-squamous intraepithelial lesion (HSIL). The interobserver agreement for colposcopic impressions was 86% (k=.684; 95% CI, 0.544-0.825; P <.001), and 66% for colposcopic impressions with exact histology (k=.416; 95% CI, 0.323-0.509; P <.001). If agreement between colposcopic impression and histology was relaxed to within 1 degree of severity, there was an 86% interobserver correlation (k=0.78; 95% CI, 0.697-0.861; P <.001). The distinction between normal metaplastic epithelium and low-grade changes accounted for all the discrepancies.

In our study, the implementation of a telecolposcopy system within the current office structure was easily accomplished, and most women accepted the telecolposcopic examination.* A total of 90.5% of the women surveyed travel 25 miles or less to their usual site of general health care; 88.1% traveled 25 miles or less for their colposcopy appointment. When the women were asked to choose whether they would prefer to have a colposcopy done locally and have the images electronically sent to another physician to be reviewed or drive farther than usual to the nearest experienced colposcopist, 95.2% of the women stated that they would have their colposcopy locally with electronic submission if the experienced colposcopist were more than 25 miles away. For the 12% of women who traveled more than 25 miles for their scheduled colposcopy, all stated they would have colposcopy locally if the experienced colposcopist was farther away than their current colposcopist.

 

 

Discussion

The telecolposcopy system captured the SCJ extremely well. Our study had an interobserver correlation of SCJ visualization similar to that seen for comparisons between different readers of the same cervigram image.26,27 To compare between review and remote sites, the colposcopist at site 1 determined the impression while at the colposcope, and the colposcopist at the review center used the same patient’s digital image. The interobserver agreement for our colposcopic image versus digital image colposcopic impressions (86%) was higher than that when both colposcopic impressions were read from colpophotographs.28 Our interobserver correlations between the colposcopic impression and histology agreed with others’ correlations for exact histologic agreement29,30 (66%) references and was within 1 degree of disease severity (86%) reference number.31 The difference in interobserver agreements for the colposcopic impression and histology correlates reflects the difficulty in determining normal metaplasia from low-grade disease, a more difficult distinction than that between normal and high-grade or cancer disease.8,28

Implementation of any organizational change within a medical office can often be difficult. It is more easily accepted when the organizational change is part of a clinical study.32 Both remote sites adopted the full telecolposcopic system (patient history data and image collection) after our study, because the teaching system, consultation reports, and record documentation were superior to the previous systems. Our study initially gave them the support and structure to use the telecolposcopic system. Implicit in adopting a new computerized system is the availability of someone to troubleshoot software and hardware problems. A remote telecolposcopic system requires that the main technical support comes from the review center, with onsite local technical help available, if necessary. In our study, technical help provided by the review center successfully kept the remote telecolposcopy systems functional with minimal effort.

More than two thirds of the women in our study were referred from their usual site of gynecologic health care to the colposcopist, and most traveled 25 miles or less to keep the appointment. Other studies have shown that women will drive more than 200 miles to participate in health care screening activities.33 We have shown that when given the choice of a local provider with telecolposcopy access or driving more than 25 miles for an experienced examination, 95% of the women preferred to receive their care from a local colposcopist. This implies that for women in rural communities, local access to colposcopy with telecolposcopic links is preferred to traveling to a distant center of colposcopic excellence. Future efforts at increasing access to colposcopy for women should be directed toward local telecolposcopic connections with a regional center of excellence for image referral.

Conclusions

We have demonstrated that telecolposcopy is feasible, can be implemented in mountainous rural office sites, and is acceptable to the women undergoing the examination. To move from a demonstration project to a regional telecolposcopic network, telemedicine standards established for all telespecialties must be followed, including appropriate licensure and encryption standards.34 Following these standards, the telecolposcopic network has the potential to offer increased access to and improved accuracy of colposcopic services. In addition, as an educational tool telecolposcopic images can be used for medical student, resident, and continuing medical education instruction, as well as direct patient education. Colposcopic training within an obstetrics and gynecology or family medicine residency training program occupies a small proportion of the curriculum. Telecolposcopy can be used to assist residents and other health care providers located at remote sites by providing access to experienced faculty and a large database of patients to review. The digital cervical images, if focused correctly, can provide more detail than the current hand-drawn documentation, which may lead to better cytologic, colposcopic, and histologic correlation.9

Colposcopists who as individuals perform a small number of colposcopies can gain knowledge from communicating between practices with the other single colposcopists through this network. They can all then anonymously compare their diagnoses with the actual biopsy result as a voluntary quality assurance and improvement program. This benchmarking can provide the groundwork for national colposcopic standards, as has been done in other countries35,36 and in the United States for mammographic image and histology correlations.37 The telecolposcopic system could focus on increasing access to colposcopy and on improving colposcopic pattern recognition skills so that high-grade disease would be targeted for treatment, and the overtreatment of low-grade disease would be avoided.

Acknowledgments

The New Hampshire Health Care Transition Fund Grant 98136, the Koop Institute, the Robert Wood Johnson Foundation, and the Division of Gynecologic Oncology, Dartmouth Medical School, have supported this work.

References

 

1. Harper DM, Parke KM, Cobb JL, Moncur MM. Improving colposcopic impressions. Arch Gynecol Obstet. In press.

2. Homesley HD, Wolff JL, Reish RL, Jobson VW. Evaluating the acquisition of colposcopy skills in an obstetric gynecologic residency program. J Repro Med 1985;30:911-14.

3. Toglia MR, Coburn KM, Pearl ML. Evaluation of colposcopic skills in an obstetrics and gynecology residency training program. J Lower Gen Tract Dis 1997;1:5-8.

4. Harper DM, DeMars LR. Is LEEP the cesarean delivery of cervical intraepithelial neoplasia? J Lower Gen Tract Dis 1997;1:257-59.

5. Darwish A, Gaddallah H. One-step management of cervical lesions. Int J Gynaecol Obstet 1998;61:261-67.

6. Roland PY, Naumann RW, Alvarez RD, Kilgore LC, Partridge EE. A decision analysis of practice patterns used in evaluating and treating abnormal Pap smears. Gynecol Oncol 1995;59:75-80.

7. Alvarez RD, Helm CW, Edwards RP, et al. Prospective randomized trial of LLETZ versus laser ablation in patients with cervical intraepithelial neoplasia. Gynecol Oncol 1994;52:175-79.

8. Etherington IJ, Luesley DM, Shafi MI, Dunn J, Hiller L, Jordan JA. Observer variability among colposcopists from the West Midlands region. Br J Obstet Gynaecol 1997;104:1380-84.

9. Shafi MI, Dunn JA, Chenoy R, Buxton EJ, Williams C, Luesley DM. Digital imaging colposcopy, image analysis and quantification of the colposcopic image. Br J Obstet Gynaecol 1994;101:234-38.

10. Dwyer TF. Telepsychiatry: psychiatric consultation by interactive television. Am J Psychiatry 1973;130:865-69.

11. Dunn BE, Almargro UA, Choi H, Recla DL, Weinstein RS. Use of telepathology for routine surgical pathology review in a test bed in the Department of Veterans Affairs. Telemed J 1997;3:1-10.

12. O’Hare NJ, Wallis F, Kennedy JM, Hickey E, et al. Specification and initial evaluation of a multiple application teleradiology system. Br J Radiol 1996;69:735-42.

13. Lesher JL, Jr, Davis LS, Gourdin FW, English D, Thompson WO. Telemedicine evaluation of cutaneous diseases: a blinded comparative study. J Am Acad Dermatol 1998;38:27-31.

14. Fisk NM, Sepulveda W, Drysdale K, et al. Fetal telemedicine: six month pilot of real-time ultrasound and video consultation between the Isle of Wight and London. Br J Obstet Gynaecol 1996;103:1092-95.

15. Landwehr JB, Jr, Zador IE, Wolfe HM, Dombrowski MP, Treadwell MC. Telemedicine and fetal ultrasonography: assessment of technical performance and clinical feasibility. Am J Obstet Gynecol 1997;177:846-48.

16. Katz M, Gill PJ. Initial evaluation of an ambulatory system for home monitoring and transmission of uterine activity data. Obstet Gynecol 1985;66:273-77.

17. Macedonia CR, Collea JV, Sanders JH. Telemedicine comes to obstetrics and gynecology. Contemp Ob Gyn 1998;43:92-111.

18. Marcus DM, Brooks SE, Ulrich LD, et al. Telemedicine diagnosis of eye disorders by direct ophthalmoscopy. A pilot study. Ophthalmology. 1998;105:1907-14.

19. Pedersen S, Hartviken G, Haga D. Teleconsultation of patients with otorhinolaryngologic conditions. Arch Otoloaryngol Head Neck Surg 1994;120:133-36.

20. Bruderman I, Abboud S. Telespirometry: novel system for home monitoring of asthmatic patients. Telemed J 1997;3:127-33.

21. Alboliras ET, Berdusis K, Fisher J, Harrison RA, Benson DW, Jr, Webb CL. Transmission of full-length echocardiographic images over ISDN for diagnosing congenital heart disease. Telemed J 1996;2:251-58.

22. Armstrong IJ, Haston WS. Medical decision support for remote general practitioners using telemedicine. J Telemed Telecare 1997;3:27-34.

23. Lambrecht CJ. Telemedicine in trauma care: description of 100 trauma teleconsults. Telemed J 1997;3:265-68.

24. StatSoft Inc. Statistica for Windows. Tulsa, Okla: StatSoft; 1998.

25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;3:159-74.

26. Sellors JW, Nieminen P, Vesterinen E, Paavonen J. Observer variability in the scoring of colpophotographs. Obstet Gynecol 1990;76:1006-8.

27. Cecchini S, Iossa A, Bonardi R, Gustavino C, Ciatto S. Evaluation of the sensitivity of cervicography in a consecutive colposcopic series. Tumori 1992;30:211-13.

28. Hopman EH, Voorhorst FJ, Kenemans P, Meyer CJ, Heolmerhorst TJ. Observer agreement on interpreting colposcopic images of CIN. Gynecol Oncol 1995;58:206-9.

29. Kortolopoulou P, Kolokythas C, Kittas C, Alevritou H, Pavlakis K. Correlation of colposcopy and histology in cervical biopsies positive for CIN and/or HPV infection. Eur J Gynaecol Oncol 1992;13:502-6.

30. Cristoforoni PM, Gerbaldo D, Perino A, Piccoli R, Montz FJ, Capitanio GL. Computerized colposcopy: results of a pilot study and analysis of its clinical relevance. Obstet Gynecol 1995;85:1011-16.

31. Lenehan PM, Sykes GS, Morris HB, Charnock MF. Correlation of colposcopy and histology findings in pre-clinical neoplasia of the cervix. Eur J Gynaecol Oncol 1987;8:87-89.

32. Lewis CE, Cheyovich TK. The clinical trial as a means for organizational change: report of a case study. Med Care 1976;14:137-45.

33. Pavlik EJ, van Nagell JR, Jr, DePriest PD, et al. Participation in transvaginal ovarian cancer screening: compliance, correlation factors, and costs. Gyn Oncol 1995;57:395-400.

34. Eliasson AH, Poropatich RK. Performance improvement in telemedicine: the essential elements. Milit Med 1998;163:530-35.

35. Benedet JL, Anderson GH, Matisic JP, Miller DM. A quality-control program for colposcopic practice. Obstet Gynecol 1991;78:872-75.

36. Cecchini S, Bonardi R, Grazzini G, et al. Training in colposcopy: experience with a videocolposcopy test. Tumori 1997;83:650-52.

37. Korn JE, Casey-Paal A, Lazovich D, Ball J, Slater JS. Impact of the mammography quality standards act on access in Minnesota. Public Health Rep 1997;112:142-45.

Author and Disclosure Information

 

Diane M. Harper, MD, MPH
Megan M. Moncur, MS
William H. Harper, MS
Gregory C. Burke, MS
Cynthia A. Rasmussen, MD
Margaret C. Mumford, MD
Hanover, New Hampshire

Issue
The Journal of Family Practice - 49(07)
Publications
Topics
Page Number
623-627
Legacy Keywords
,Colposcopypatient satisfactionvaginal smearstechnology assessment, biomedical. (J Fam Pract 2000; 49:623-627)
Sections
Author and Disclosure Information

 

Diane M. Harper, MD, MPH
Megan M. Moncur, MS
William H. Harper, MS
Gregory C. Burke, MS
Cynthia A. Rasmussen, MD
Margaret C. Mumford, MD
Hanover, New Hampshire

Author and Disclosure Information

 

Diane M. Harper, MD, MPH
Megan M. Moncur, MS
William H. Harper, MS
Gregory C. Burke, MS
Cynthia A. Rasmussen, MD
Margaret C. Mumford, MD
Hanover, New Hampshire

 

BACKGROUND: The purpose of our study was to demonstrate the technical performance and clinical feasibility of a telecolposcopic system through assessment of image transmission veracity, ease of office system implementation, and the patient’s acceptance of the electronic image transmission.

METHODS: We used a telecolposcopic system incorporating a custom software package that integrated patient history, current gynecologic status, epidemiologic risk factors, and colposcopic images for local medical documentation and transmission. Satisfaction questionnaires were developed to measure ease of implementation at the remote sites and the patients’ acceptance of telecolposcopy.

RESULTS: Seventy-nine women participated in our trial. From 3 to 20 images were captured for each woman, documenting cervical squamous intraepithelial lesions and vaginal and vulvar diseases. All images were received without distortions in color, size, or orientation. With complete visualization of the squamocolumnar junction there was an 86% agreement between the remote and review sites (k=.533, P=.019). The interobserver agreement for colposcopic impressions was 86% (k=.684, P <.001), and for colposcopic impressions with histology within one level of disease severity,86%(k=.78,P<.001).Col-poscopists’ and patients’ satisfaction with telecolposcopy was excellent. More than 95% of the women stated that they would rather have their colposcopy locally with electronic transmission if an experienced colposcopist were more than 25 miles away.

CONCLUSIONS: The telecolposcopic system described in our study is technically feasible, can be implemented in an office system with limited technical support, and is preferred by women who have to travel many miles to receive referral health care.

The goal of colposcopy is to identify women with high-grade disease through appropriately targeted biopsy and to correlate the cytologic-colposcopic-histologic results into a cohesive and appropriate management strategy. Approximately 80% of gynecologists and 10% of family physicians in New Hampshire currently provide access to colposcopy. These physicians have a desire to network to improve their colposcopic accuracy.1 Little work has been published either to define adequate access to colposcopy for any population of women or to improve colposcopic accuracy. Active maintenance and improvement of colposcopic skills are important, because they deteriorate after initial training. Several studies have reported lower than 50% sensitivity for detecting the quadrant of the cervix where the cervical intraepithelial neoplasia (CIN) is present.2-4 “See and treat” electrosurgical loop excision procedures have resulted in up to 50% of the specimens being histologically normal.5-9 These high rates of inaccuracy happen because of colposcopists’ inability to distinguish normal from abnormal cervical tissue. Without a dedicated desire to maintain and improve their skills, colposcopists may inadvertently overtreat women on the pretext of preventing cervical cancer.

One potential method for improving colposcopic recognition skills is the development of a network of telecolposcopists who share patient histories, colposcopic images, and histology correlations on a routine basis. Before determining whether this network would improve colposcopic care, it must first be shown that telecolposcopic images can be transmitted to and recognized accurately at the reception site.

Radiologists, dermatologists, pathologists, and psychiatrists10-13 have accurately relayed image transmissions. The fields of otorhinolaryngology, ophthalmology, cardiology, pulmonology, and emergency medicine have also reported telemedicine capabilities during the past few years. Teleobstetrics has demonstrated the feasibility of remote fetal ultrasonography and home monitoring of uterine activity accurately portraying fetal anomalies and uterine contractility.14-17 Colposcopy provides similar visual information about a woman’s gynecologic health. The parameters for successful telemedical image interpretation have been established for these other fields by studying the correlation between the telemedicine image and the conventional diagnostic modality.11-13,18-23

The purpose of our project was to demonstrate the technical performance and clinical feasibility of a low-end telecolposcopic system in a rural mountainous environment. Our primary goal was to determine if the transmission of colposcopic images was technically feasible and would be accurately received in an environment where the ground terrain prohibits radio wave and some satellite transmissions. Our secondary goals were to determine whether the telecolposcopy system could be incorporated into a busy medical office with minimal disruption and to determine how it affects the woman’s perceptions of the colposcopic examination. We included several questions to determine how far each woman was willing to travel to see the expert in person rather than participate in telecolposcopy.

Methods

The Review and Remote Site Selection

The review site was based at the Dartmouth Hitchcock Medical Center (DHMC), where an experienced colposcopist reviewed all images. Two remote sites were chosen for this feasibility study: The first site was a single-physician practice located in rural New Hampshire; the second site was an urban residency training clinic remote from DHMC.*

The telecolposcopic system was designed to maximize the quality of digitized images viewed during the examination and deliver those images electronically to the review center. The computer system was installed by the computer support personnel at each remote site in less than 2 hours, and included a brief introduction to the software and 3 to 5 trial runs with mock patients. Computer support personnel visited both sites one additional time during the study to answer software, hardware, and transmission questions. Our study received approval from the Committee on Protection of Human Subjects from Dartmouth Medical School.

 

 

A provider survey was designed to document the learning curve of the computer-based digital colposcopic system in an office with limited computer support available (site 1). A 23-question patient satisfaction survey was administered in 2 parts to assess the acceptability of telecolposcopy to women undergoing a colposcopic examination.

Implementation of the Telecolposcopic System

Any woman 18 years or older and scheduled for colposcopy was eligible for enrollment in the study between October 1997 and May 1998. There were no other inclusion or exclusion criteria. After consent was obtained, the woman was given patient education materials to read and asked to complete the first part of the survey. The colposcopic examination was completed as usual, except that images were focused and captured throughout the examination to document the visualization of the entire squamocolumnar junction (SCJ), transformation zone, and any visible lesions in the anogenital area. The colposcopist entered a follow-up plan in the computerized patient record. The images and history were then printed for the patient’s chart. The patient was asked to complete the second part of the satisfaction questionnaire before dismissal, and the physician was asked to complete the provider satisfaction questionnaire. The woman’s cytology and histology results were processed and read by the site’s routine pathology laboratory and were entered into the study database. The review site colposcopist was blinded to the primary colposcopist’s impressions, the woman’s cytology and histology, and any information on the questionnaires.

Statistical Analysis

Our study has a 90% power to determine a statistically significant k correlation, at the 0.05 2-tailed level, between the remote and review site colposcopists’ identification of the SCJ and their impressions of lesion severity and between each colposcopist’s impression and pathology. We used k correlation, independent and paired t tests, and descriptive statistics in this study. All statistics were calculated with Statistica (StatSoft, Tulsa, Oklahoma).24

Results

A total of 79 women participated in our study. Sites 1 and 2 captured images of 39 and 40 women, respectively, representing 100% of the women scheduled for colposcopy at each site during the study. All women were white and ranged in age from 18 to 57 years, with a mean age of 29.5 years (standard deviation=11.5). Thirty-five percent of the women received their colposcopy at their usual site of gynecologic health care; the others were referred from outside offices where colposcopy was not available. The [Table] shows the descriptive data of the women participating in the project: 79% had a history of previous abnormal anogenital lesions; 65% presented with either atypical squamous cells of undetermined significance or low-grade squamous intraepithelial lesion (LSIL) cytology, and approximately 20% had a CIN 2/3 lesion histologically.

Technical Feasibility

The number of images captured for each patient varied from 3 to 20, and the details of the patient’s gynecologic history varied from the current visit data to an extensive past medical and gynecologic history. The average time for transmission of one patient’s images was 6 minutes.

Technical feasibility was measured by the percentage of agreement between the review and both remote sites for colposcopic impressions and histology correlates. A k value greater than 0.75 denotes excellent agreement, between 0.4 and 0.75 is good agreement, and below 0.4 is marginal agreement.25 For all examinations, the physician at the remote sites attempted to capture the SCJ for transmission. The SCJ was noted as “completely visualized” or “not visualized.” There was 86% agreement in complete visualization of the SCJ between the review and the remote sites (k=.533; 95% confidence interval [CI], 0.276-0.791; P=.019).

Both remote and review site physicians classified the colposcopic cervical impression as normal, LSIL, or high-grade-squamous intraepithelial lesion (HSIL). The interobserver agreement for colposcopic impressions was 86% (k=.684; 95% CI, 0.544-0.825; P <.001), and 66% for colposcopic impressions with exact histology (k=.416; 95% CI, 0.323-0.509; P <.001). If agreement between colposcopic impression and histology was relaxed to within 1 degree of severity, there was an 86% interobserver correlation (k=0.78; 95% CI, 0.697-0.861; P <.001). The distinction between normal metaplastic epithelium and low-grade changes accounted for all the discrepancies.

In our study, the implementation of a telecolposcopy system within the current office structure was easily accomplished, and most women accepted the telecolposcopic examination.* A total of 90.5% of the women surveyed travel 25 miles or less to their usual site of general health care; 88.1% traveled 25 miles or less for their colposcopy appointment. When the women were asked to choose whether they would prefer to have a colposcopy done locally and have the images electronically sent to another physician to be reviewed or drive farther than usual to the nearest experienced colposcopist, 95.2% of the women stated that they would have their colposcopy locally with electronic submission if the experienced colposcopist were more than 25 miles away. For the 12% of women who traveled more than 25 miles for their scheduled colposcopy, all stated they would have colposcopy locally if the experienced colposcopist was farther away than their current colposcopist.

 

 

Discussion

The telecolposcopy system captured the SCJ extremely well. Our study had an interobserver correlation of SCJ visualization similar to that seen for comparisons between different readers of the same cervigram image.26,27 To compare between review and remote sites, the colposcopist at site 1 determined the impression while at the colposcope, and the colposcopist at the review center used the same patient’s digital image. The interobserver agreement for our colposcopic image versus digital image colposcopic impressions (86%) was higher than that when both colposcopic impressions were read from colpophotographs.28 Our interobserver correlations between the colposcopic impression and histology agreed with others’ correlations for exact histologic agreement29,30 (66%) references and was within 1 degree of disease severity (86%) reference number.31 The difference in interobserver agreements for the colposcopic impression and histology correlates reflects the difficulty in determining normal metaplasia from low-grade disease, a more difficult distinction than that between normal and high-grade or cancer disease.8,28

Implementation of any organizational change within a medical office can often be difficult. It is more easily accepted when the organizational change is part of a clinical study.32 Both remote sites adopted the full telecolposcopic system (patient history data and image collection) after our study, because the teaching system, consultation reports, and record documentation were superior to the previous systems. Our study initially gave them the support and structure to use the telecolposcopic system. Implicit in adopting a new computerized system is the availability of someone to troubleshoot software and hardware problems. A remote telecolposcopic system requires that the main technical support comes from the review center, with onsite local technical help available, if necessary. In our study, technical help provided by the review center successfully kept the remote telecolposcopy systems functional with minimal effort.

More than two thirds of the women in our study were referred from their usual site of gynecologic health care to the colposcopist, and most traveled 25 miles or less to keep the appointment. Other studies have shown that women will drive more than 200 miles to participate in health care screening activities.33 We have shown that when given the choice of a local provider with telecolposcopy access or driving more than 25 miles for an experienced examination, 95% of the women preferred to receive their care from a local colposcopist. This implies that for women in rural communities, local access to colposcopy with telecolposcopic links is preferred to traveling to a distant center of colposcopic excellence. Future efforts at increasing access to colposcopy for women should be directed toward local telecolposcopic connections with a regional center of excellence for image referral.

Conclusions

We have demonstrated that telecolposcopy is feasible, can be implemented in mountainous rural office sites, and is acceptable to the women undergoing the examination. To move from a demonstration project to a regional telecolposcopic network, telemedicine standards established for all telespecialties must be followed, including appropriate licensure and encryption standards.34 Following these standards, the telecolposcopic network has the potential to offer increased access to and improved accuracy of colposcopic services. In addition, as an educational tool telecolposcopic images can be used for medical student, resident, and continuing medical education instruction, as well as direct patient education. Colposcopic training within an obstetrics and gynecology or family medicine residency training program occupies a small proportion of the curriculum. Telecolposcopy can be used to assist residents and other health care providers located at remote sites by providing access to experienced faculty and a large database of patients to review. The digital cervical images, if focused correctly, can provide more detail than the current hand-drawn documentation, which may lead to better cytologic, colposcopic, and histologic correlation.9

Colposcopists who as individuals perform a small number of colposcopies can gain knowledge from communicating between practices with the other single colposcopists through this network. They can all then anonymously compare their diagnoses with the actual biopsy result as a voluntary quality assurance and improvement program. This benchmarking can provide the groundwork for national colposcopic standards, as has been done in other countries35,36 and in the United States for mammographic image and histology correlations.37 The telecolposcopic system could focus on increasing access to colposcopy and on improving colposcopic pattern recognition skills so that high-grade disease would be targeted for treatment, and the overtreatment of low-grade disease would be avoided.

Acknowledgments

The New Hampshire Health Care Transition Fund Grant 98136, the Koop Institute, the Robert Wood Johnson Foundation, and the Division of Gynecologic Oncology, Dartmouth Medical School, have supported this work.

 

BACKGROUND: The purpose of our study was to demonstrate the technical performance and clinical feasibility of a telecolposcopic system through assessment of image transmission veracity, ease of office system implementation, and the patient’s acceptance of the electronic image transmission.

METHODS: We used a telecolposcopic system incorporating a custom software package that integrated patient history, current gynecologic status, epidemiologic risk factors, and colposcopic images for local medical documentation and transmission. Satisfaction questionnaires were developed to measure ease of implementation at the remote sites and the patients’ acceptance of telecolposcopy.

RESULTS: Seventy-nine women participated in our trial. From 3 to 20 images were captured for each woman, documenting cervical squamous intraepithelial lesions and vaginal and vulvar diseases. All images were received without distortions in color, size, or orientation. With complete visualization of the squamocolumnar junction there was an 86% agreement between the remote and review sites (k=.533, P=.019). The interobserver agreement for colposcopic impressions was 86% (k=.684, P <.001), and for colposcopic impressions with histology within one level of disease severity,86%(k=.78,P<.001).Col-poscopists’ and patients’ satisfaction with telecolposcopy was excellent. More than 95% of the women stated that they would rather have their colposcopy locally with electronic transmission if an experienced colposcopist were more than 25 miles away.

CONCLUSIONS: The telecolposcopic system described in our study is technically feasible, can be implemented in an office system with limited technical support, and is preferred by women who have to travel many miles to receive referral health care.

The goal of colposcopy is to identify women with high-grade disease through appropriately targeted biopsy and to correlate the cytologic-colposcopic-histologic results into a cohesive and appropriate management strategy. Approximately 80% of gynecologists and 10% of family physicians in New Hampshire currently provide access to colposcopy. These physicians have a desire to network to improve their colposcopic accuracy.1 Little work has been published either to define adequate access to colposcopy for any population of women or to improve colposcopic accuracy. Active maintenance and improvement of colposcopic skills are important, because they deteriorate after initial training. Several studies have reported lower than 50% sensitivity for detecting the quadrant of the cervix where the cervical intraepithelial neoplasia (CIN) is present.2-4 “See and treat” electrosurgical loop excision procedures have resulted in up to 50% of the specimens being histologically normal.5-9 These high rates of inaccuracy happen because of colposcopists’ inability to distinguish normal from abnormal cervical tissue. Without a dedicated desire to maintain and improve their skills, colposcopists may inadvertently overtreat women on the pretext of preventing cervical cancer.

One potential method for improving colposcopic recognition skills is the development of a network of telecolposcopists who share patient histories, colposcopic images, and histology correlations on a routine basis. Before determining whether this network would improve colposcopic care, it must first be shown that telecolposcopic images can be transmitted to and recognized accurately at the reception site.

Radiologists, dermatologists, pathologists, and psychiatrists10-13 have accurately relayed image transmissions. The fields of otorhinolaryngology, ophthalmology, cardiology, pulmonology, and emergency medicine have also reported telemedicine capabilities during the past few years. Teleobstetrics has demonstrated the feasibility of remote fetal ultrasonography and home monitoring of uterine activity accurately portraying fetal anomalies and uterine contractility.14-17 Colposcopy provides similar visual information about a woman’s gynecologic health. The parameters for successful telemedical image interpretation have been established for these other fields by studying the correlation between the telemedicine image and the conventional diagnostic modality.11-13,18-23

The purpose of our project was to demonstrate the technical performance and clinical feasibility of a low-end telecolposcopic system in a rural mountainous environment. Our primary goal was to determine if the transmission of colposcopic images was technically feasible and would be accurately received in an environment where the ground terrain prohibits radio wave and some satellite transmissions. Our secondary goals were to determine whether the telecolposcopy system could be incorporated into a busy medical office with minimal disruption and to determine how it affects the woman’s perceptions of the colposcopic examination. We included several questions to determine how far each woman was willing to travel to see the expert in person rather than participate in telecolposcopy.

Methods

The Review and Remote Site Selection

The review site was based at the Dartmouth Hitchcock Medical Center (DHMC), where an experienced colposcopist reviewed all images. Two remote sites were chosen for this feasibility study: The first site was a single-physician practice located in rural New Hampshire; the second site was an urban residency training clinic remote from DHMC.*

The telecolposcopic system was designed to maximize the quality of digitized images viewed during the examination and deliver those images electronically to the review center. The computer system was installed by the computer support personnel at each remote site in less than 2 hours, and included a brief introduction to the software and 3 to 5 trial runs with mock patients. Computer support personnel visited both sites one additional time during the study to answer software, hardware, and transmission questions. Our study received approval from the Committee on Protection of Human Subjects from Dartmouth Medical School.

 

 

A provider survey was designed to document the learning curve of the computer-based digital colposcopic system in an office with limited computer support available (site 1). A 23-question patient satisfaction survey was administered in 2 parts to assess the acceptability of telecolposcopy to women undergoing a colposcopic examination.

Implementation of the Telecolposcopic System

Any woman 18 years or older and scheduled for colposcopy was eligible for enrollment in the study between October 1997 and May 1998. There were no other inclusion or exclusion criteria. After consent was obtained, the woman was given patient education materials to read and asked to complete the first part of the survey. The colposcopic examination was completed as usual, except that images were focused and captured throughout the examination to document the visualization of the entire squamocolumnar junction (SCJ), transformation zone, and any visible lesions in the anogenital area. The colposcopist entered a follow-up plan in the computerized patient record. The images and history were then printed for the patient’s chart. The patient was asked to complete the second part of the satisfaction questionnaire before dismissal, and the physician was asked to complete the provider satisfaction questionnaire. The woman’s cytology and histology results were processed and read by the site’s routine pathology laboratory and were entered into the study database. The review site colposcopist was blinded to the primary colposcopist’s impressions, the woman’s cytology and histology, and any information on the questionnaires.

Statistical Analysis

Our study has a 90% power to determine a statistically significant k correlation, at the 0.05 2-tailed level, between the remote and review site colposcopists’ identification of the SCJ and their impressions of lesion severity and between each colposcopist’s impression and pathology. We used k correlation, independent and paired t tests, and descriptive statistics in this study. All statistics were calculated with Statistica (StatSoft, Tulsa, Oklahoma).24

Results

A total of 79 women participated in our study. Sites 1 and 2 captured images of 39 and 40 women, respectively, representing 100% of the women scheduled for colposcopy at each site during the study. All women were white and ranged in age from 18 to 57 years, with a mean age of 29.5 years (standard deviation=11.5). Thirty-five percent of the women received their colposcopy at their usual site of gynecologic health care; the others were referred from outside offices where colposcopy was not available. The [Table] shows the descriptive data of the women participating in the project: 79% had a history of previous abnormal anogenital lesions; 65% presented with either atypical squamous cells of undetermined significance or low-grade squamous intraepithelial lesion (LSIL) cytology, and approximately 20% had a CIN 2/3 lesion histologically.

Technical Feasibility

The number of images captured for each patient varied from 3 to 20, and the details of the patient’s gynecologic history varied from the current visit data to an extensive past medical and gynecologic history. The average time for transmission of one patient’s images was 6 minutes.

Technical feasibility was measured by the percentage of agreement between the review and both remote sites for colposcopic impressions and histology correlates. A k value greater than 0.75 denotes excellent agreement, between 0.4 and 0.75 is good agreement, and below 0.4 is marginal agreement.25 For all examinations, the physician at the remote sites attempted to capture the SCJ for transmission. The SCJ was noted as “completely visualized” or “not visualized.” There was 86% agreement in complete visualization of the SCJ between the review and the remote sites (k=.533; 95% confidence interval [CI], 0.276-0.791; P=.019).

Both remote and review site physicians classified the colposcopic cervical impression as normal, LSIL, or high-grade-squamous intraepithelial lesion (HSIL). The interobserver agreement for colposcopic impressions was 86% (k=.684; 95% CI, 0.544-0.825; P <.001), and 66% for colposcopic impressions with exact histology (k=.416; 95% CI, 0.323-0.509; P <.001). If agreement between colposcopic impression and histology was relaxed to within 1 degree of severity, there was an 86% interobserver correlation (k=0.78; 95% CI, 0.697-0.861; P <.001). The distinction between normal metaplastic epithelium and low-grade changes accounted for all the discrepancies.

In our study, the implementation of a telecolposcopy system within the current office structure was easily accomplished, and most women accepted the telecolposcopic examination.* A total of 90.5% of the women surveyed travel 25 miles or less to their usual site of general health care; 88.1% traveled 25 miles or less for their colposcopy appointment. When the women were asked to choose whether they would prefer to have a colposcopy done locally and have the images electronically sent to another physician to be reviewed or drive farther than usual to the nearest experienced colposcopist, 95.2% of the women stated that they would have their colposcopy locally with electronic submission if the experienced colposcopist were more than 25 miles away. For the 12% of women who traveled more than 25 miles for their scheduled colposcopy, all stated they would have colposcopy locally if the experienced colposcopist was farther away than their current colposcopist.

 

 

Discussion

The telecolposcopy system captured the SCJ extremely well. Our study had an interobserver correlation of SCJ visualization similar to that seen for comparisons between different readers of the same cervigram image.26,27 To compare between review and remote sites, the colposcopist at site 1 determined the impression while at the colposcope, and the colposcopist at the review center used the same patient’s digital image. The interobserver agreement for our colposcopic image versus digital image colposcopic impressions (86%) was higher than that when both colposcopic impressions were read from colpophotographs.28 Our interobserver correlations between the colposcopic impression and histology agreed with others’ correlations for exact histologic agreement29,30 (66%) references and was within 1 degree of disease severity (86%) reference number.31 The difference in interobserver agreements for the colposcopic impression and histology correlates reflects the difficulty in determining normal metaplasia from low-grade disease, a more difficult distinction than that between normal and high-grade or cancer disease.8,28

Implementation of any organizational change within a medical office can often be difficult. It is more easily accepted when the organizational change is part of a clinical study.32 Both remote sites adopted the full telecolposcopic system (patient history data and image collection) after our study, because the teaching system, consultation reports, and record documentation were superior to the previous systems. Our study initially gave them the support and structure to use the telecolposcopic system. Implicit in adopting a new computerized system is the availability of someone to troubleshoot software and hardware problems. A remote telecolposcopic system requires that the main technical support comes from the review center, with onsite local technical help available, if necessary. In our study, technical help provided by the review center successfully kept the remote telecolposcopy systems functional with minimal effort.

More than two thirds of the women in our study were referred from their usual site of gynecologic health care to the colposcopist, and most traveled 25 miles or less to keep the appointment. Other studies have shown that women will drive more than 200 miles to participate in health care screening activities.33 We have shown that when given the choice of a local provider with telecolposcopy access or driving more than 25 miles for an experienced examination, 95% of the women preferred to receive their care from a local colposcopist. This implies that for women in rural communities, local access to colposcopy with telecolposcopic links is preferred to traveling to a distant center of colposcopic excellence. Future efforts at increasing access to colposcopy for women should be directed toward local telecolposcopic connections with a regional center of excellence for image referral.

Conclusions

We have demonstrated that telecolposcopy is feasible, can be implemented in mountainous rural office sites, and is acceptable to the women undergoing the examination. To move from a demonstration project to a regional telecolposcopic network, telemedicine standards established for all telespecialties must be followed, including appropriate licensure and encryption standards.34 Following these standards, the telecolposcopic network has the potential to offer increased access to and improved accuracy of colposcopic services. In addition, as an educational tool telecolposcopic images can be used for medical student, resident, and continuing medical education instruction, as well as direct patient education. Colposcopic training within an obstetrics and gynecology or family medicine residency training program occupies a small proportion of the curriculum. Telecolposcopy can be used to assist residents and other health care providers located at remote sites by providing access to experienced faculty and a large database of patients to review. The digital cervical images, if focused correctly, can provide more detail than the current hand-drawn documentation, which may lead to better cytologic, colposcopic, and histologic correlation.9

Colposcopists who as individuals perform a small number of colposcopies can gain knowledge from communicating between practices with the other single colposcopists through this network. They can all then anonymously compare their diagnoses with the actual biopsy result as a voluntary quality assurance and improvement program. This benchmarking can provide the groundwork for national colposcopic standards, as has been done in other countries35,36 and in the United States for mammographic image and histology correlations.37 The telecolposcopic system could focus on increasing access to colposcopy and on improving colposcopic pattern recognition skills so that high-grade disease would be targeted for treatment, and the overtreatment of low-grade disease would be avoided.

Acknowledgments

The New Hampshire Health Care Transition Fund Grant 98136, the Koop Institute, the Robert Wood Johnson Foundation, and the Division of Gynecologic Oncology, Dartmouth Medical School, have supported this work.

References

 

1. Harper DM, Parke KM, Cobb JL, Moncur MM. Improving colposcopic impressions. Arch Gynecol Obstet. In press.

2. Homesley HD, Wolff JL, Reish RL, Jobson VW. Evaluating the acquisition of colposcopy skills in an obstetric gynecologic residency program. J Repro Med 1985;30:911-14.

3. Toglia MR, Coburn KM, Pearl ML. Evaluation of colposcopic skills in an obstetrics and gynecology residency training program. J Lower Gen Tract Dis 1997;1:5-8.

4. Harper DM, DeMars LR. Is LEEP the cesarean delivery of cervical intraepithelial neoplasia? J Lower Gen Tract Dis 1997;1:257-59.

5. Darwish A, Gaddallah H. One-step management of cervical lesions. Int J Gynaecol Obstet 1998;61:261-67.

6. Roland PY, Naumann RW, Alvarez RD, Kilgore LC, Partridge EE. A decision analysis of practice patterns used in evaluating and treating abnormal Pap smears. Gynecol Oncol 1995;59:75-80.

7. Alvarez RD, Helm CW, Edwards RP, et al. Prospective randomized trial of LLETZ versus laser ablation in patients with cervical intraepithelial neoplasia. Gynecol Oncol 1994;52:175-79.

8. Etherington IJ, Luesley DM, Shafi MI, Dunn J, Hiller L, Jordan JA. Observer variability among colposcopists from the West Midlands region. Br J Obstet Gynaecol 1997;104:1380-84.

9. Shafi MI, Dunn JA, Chenoy R, Buxton EJ, Williams C, Luesley DM. Digital imaging colposcopy, image analysis and quantification of the colposcopic image. Br J Obstet Gynaecol 1994;101:234-38.

10. Dwyer TF. Telepsychiatry: psychiatric consultation by interactive television. Am J Psychiatry 1973;130:865-69.

11. Dunn BE, Almargro UA, Choi H, Recla DL, Weinstein RS. Use of telepathology for routine surgical pathology review in a test bed in the Department of Veterans Affairs. Telemed J 1997;3:1-10.

12. O’Hare NJ, Wallis F, Kennedy JM, Hickey E, et al. Specification and initial evaluation of a multiple application teleradiology system. Br J Radiol 1996;69:735-42.

13. Lesher JL, Jr, Davis LS, Gourdin FW, English D, Thompson WO. Telemedicine evaluation of cutaneous diseases: a blinded comparative study. J Am Acad Dermatol 1998;38:27-31.

14. Fisk NM, Sepulveda W, Drysdale K, et al. Fetal telemedicine: six month pilot of real-time ultrasound and video consultation between the Isle of Wight and London. Br J Obstet Gynaecol 1996;103:1092-95.

15. Landwehr JB, Jr, Zador IE, Wolfe HM, Dombrowski MP, Treadwell MC. Telemedicine and fetal ultrasonography: assessment of technical performance and clinical feasibility. Am J Obstet Gynecol 1997;177:846-48.

16. Katz M, Gill PJ. Initial evaluation of an ambulatory system for home monitoring and transmission of uterine activity data. Obstet Gynecol 1985;66:273-77.

17. Macedonia CR, Collea JV, Sanders JH. Telemedicine comes to obstetrics and gynecology. Contemp Ob Gyn 1998;43:92-111.

18. Marcus DM, Brooks SE, Ulrich LD, et al. Telemedicine diagnosis of eye disorders by direct ophthalmoscopy. A pilot study. Ophthalmology. 1998;105:1907-14.

19. Pedersen S, Hartviken G, Haga D. Teleconsultation of patients with otorhinolaryngologic conditions. Arch Otoloaryngol Head Neck Surg 1994;120:133-36.

20. Bruderman I, Abboud S. Telespirometry: novel system for home monitoring of asthmatic patients. Telemed J 1997;3:127-33.

21. Alboliras ET, Berdusis K, Fisher J, Harrison RA, Benson DW, Jr, Webb CL. Transmission of full-length echocardiographic images over ISDN for diagnosing congenital heart disease. Telemed J 1996;2:251-58.

22. Armstrong IJ, Haston WS. Medical decision support for remote general practitioners using telemedicine. J Telemed Telecare 1997;3:27-34.

23. Lambrecht CJ. Telemedicine in trauma care: description of 100 trauma teleconsults. Telemed J 1997;3:265-68.

24. StatSoft Inc. Statistica for Windows. Tulsa, Okla: StatSoft; 1998.

25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;3:159-74.

26. Sellors JW, Nieminen P, Vesterinen E, Paavonen J. Observer variability in the scoring of colpophotographs. Obstet Gynecol 1990;76:1006-8.

27. Cecchini S, Iossa A, Bonardi R, Gustavino C, Ciatto S. Evaluation of the sensitivity of cervicography in a consecutive colposcopic series. Tumori 1992;30:211-13.

28. Hopman EH, Voorhorst FJ, Kenemans P, Meyer CJ, Heolmerhorst TJ. Observer agreement on interpreting colposcopic images of CIN. Gynecol Oncol 1995;58:206-9.

29. Kortolopoulou P, Kolokythas C, Kittas C, Alevritou H, Pavlakis K. Correlation of colposcopy and histology in cervical biopsies positive for CIN and/or HPV infection. Eur J Gynaecol Oncol 1992;13:502-6.

30. Cristoforoni PM, Gerbaldo D, Perino A, Piccoli R, Montz FJ, Capitanio GL. Computerized colposcopy: results of a pilot study and analysis of its clinical relevance. Obstet Gynecol 1995;85:1011-16.

31. Lenehan PM, Sykes GS, Morris HB, Charnock MF. Correlation of colposcopy and histology findings in pre-clinical neoplasia of the cervix. Eur J Gynaecol Oncol 1987;8:87-89.

32. Lewis CE, Cheyovich TK. The clinical trial as a means for organizational change: report of a case study. Med Care 1976;14:137-45.

33. Pavlik EJ, van Nagell JR, Jr, DePriest PD, et al. Participation in transvaginal ovarian cancer screening: compliance, correlation factors, and costs. Gyn Oncol 1995;57:395-400.

34. Eliasson AH, Poropatich RK. Performance improvement in telemedicine: the essential elements. Milit Med 1998;163:530-35.

35. Benedet JL, Anderson GH, Matisic JP, Miller DM. A quality-control program for colposcopic practice. Obstet Gynecol 1991;78:872-75.

36. Cecchini S, Bonardi R, Grazzini G, et al. Training in colposcopy: experience with a videocolposcopy test. Tumori 1997;83:650-52.

37. Korn JE, Casey-Paal A, Lazovich D, Ball J, Slater JS. Impact of the mammography quality standards act on access in Minnesota. Public Health Rep 1997;112:142-45.

References

 

1. Harper DM, Parke KM, Cobb JL, Moncur MM. Improving colposcopic impressions. Arch Gynecol Obstet. In press.

2. Homesley HD, Wolff JL, Reish RL, Jobson VW. Evaluating the acquisition of colposcopy skills in an obstetric gynecologic residency program. J Repro Med 1985;30:911-14.

3. Toglia MR, Coburn KM, Pearl ML. Evaluation of colposcopic skills in an obstetrics and gynecology residency training program. J Lower Gen Tract Dis 1997;1:5-8.

4. Harper DM, DeMars LR. Is LEEP the cesarean delivery of cervical intraepithelial neoplasia? J Lower Gen Tract Dis 1997;1:257-59.

5. Darwish A, Gaddallah H. One-step management of cervical lesions. Int J Gynaecol Obstet 1998;61:261-67.

6. Roland PY, Naumann RW, Alvarez RD, Kilgore LC, Partridge EE. A decision analysis of practice patterns used in evaluating and treating abnormal Pap smears. Gynecol Oncol 1995;59:75-80.

7. Alvarez RD, Helm CW, Edwards RP, et al. Prospective randomized trial of LLETZ versus laser ablation in patients with cervical intraepithelial neoplasia. Gynecol Oncol 1994;52:175-79.

8. Etherington IJ, Luesley DM, Shafi MI, Dunn J, Hiller L, Jordan JA. Observer variability among colposcopists from the West Midlands region. Br J Obstet Gynaecol 1997;104:1380-84.

9. Shafi MI, Dunn JA, Chenoy R, Buxton EJ, Williams C, Luesley DM. Digital imaging colposcopy, image analysis and quantification of the colposcopic image. Br J Obstet Gynaecol 1994;101:234-38.

10. Dwyer TF. Telepsychiatry: psychiatric consultation by interactive television. Am J Psychiatry 1973;130:865-69.

11. Dunn BE, Almargro UA, Choi H, Recla DL, Weinstein RS. Use of telepathology for routine surgical pathology review in a test bed in the Department of Veterans Affairs. Telemed J 1997;3:1-10.

12. O’Hare NJ, Wallis F, Kennedy JM, Hickey E, et al. Specification and initial evaluation of a multiple application teleradiology system. Br J Radiol 1996;69:735-42.

13. Lesher JL, Jr, Davis LS, Gourdin FW, English D, Thompson WO. Telemedicine evaluation of cutaneous diseases: a blinded comparative study. J Am Acad Dermatol 1998;38:27-31.

14. Fisk NM, Sepulveda W, Drysdale K, et al. Fetal telemedicine: six month pilot of real-time ultrasound and video consultation between the Isle of Wight and London. Br J Obstet Gynaecol 1996;103:1092-95.

15. Landwehr JB, Jr, Zador IE, Wolfe HM, Dombrowski MP, Treadwell MC. Telemedicine and fetal ultrasonography: assessment of technical performance and clinical feasibility. Am J Obstet Gynecol 1997;177:846-48.

16. Katz M, Gill PJ. Initial evaluation of an ambulatory system for home monitoring and transmission of uterine activity data. Obstet Gynecol 1985;66:273-77.

17. Macedonia CR, Collea JV, Sanders JH. Telemedicine comes to obstetrics and gynecology. Contemp Ob Gyn 1998;43:92-111.

18. Marcus DM, Brooks SE, Ulrich LD, et al. Telemedicine diagnosis of eye disorders by direct ophthalmoscopy. A pilot study. Ophthalmology. 1998;105:1907-14.

19. Pedersen S, Hartviken G, Haga D. Teleconsultation of patients with otorhinolaryngologic conditions. Arch Otoloaryngol Head Neck Surg 1994;120:133-36.

20. Bruderman I, Abboud S. Telespirometry: novel system for home monitoring of asthmatic patients. Telemed J 1997;3:127-33.

21. Alboliras ET, Berdusis K, Fisher J, Harrison RA, Benson DW, Jr, Webb CL. Transmission of full-length echocardiographic images over ISDN for diagnosing congenital heart disease. Telemed J 1996;2:251-58.

22. Armstrong IJ, Haston WS. Medical decision support for remote general practitioners using telemedicine. J Telemed Telecare 1997;3:27-34.

23. Lambrecht CJ. Telemedicine in trauma care: description of 100 trauma teleconsults. Telemed J 1997;3:265-68.

24. StatSoft Inc. Statistica for Windows. Tulsa, Okla: StatSoft; 1998.

25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;3:159-74.

26. Sellors JW, Nieminen P, Vesterinen E, Paavonen J. Observer variability in the scoring of colpophotographs. Obstet Gynecol 1990;76:1006-8.

27. Cecchini S, Iossa A, Bonardi R, Gustavino C, Ciatto S. Evaluation of the sensitivity of cervicography in a consecutive colposcopic series. Tumori 1992;30:211-13.

28. Hopman EH, Voorhorst FJ, Kenemans P, Meyer CJ, Heolmerhorst TJ. Observer agreement on interpreting colposcopic images of CIN. Gynecol Oncol 1995;58:206-9.

29. Kortolopoulou P, Kolokythas C, Kittas C, Alevritou H, Pavlakis K. Correlation of colposcopy and histology in cervical biopsies positive for CIN and/or HPV infection. Eur J Gynaecol Oncol 1992;13:502-6.

30. Cristoforoni PM, Gerbaldo D, Perino A, Piccoli R, Montz FJ, Capitanio GL. Computerized colposcopy: results of a pilot study and analysis of its clinical relevance. Obstet Gynecol 1995;85:1011-16.

31. Lenehan PM, Sykes GS, Morris HB, Charnock MF. Correlation of colposcopy and histology findings in pre-clinical neoplasia of the cervix. Eur J Gynaecol Oncol 1987;8:87-89.

32. Lewis CE, Cheyovich TK. The clinical trial as a means for organizational change: report of a case study. Med Care 1976;14:137-45.

33. Pavlik EJ, van Nagell JR, Jr, DePriest PD, et al. Participation in transvaginal ovarian cancer screening: compliance, correlation factors, and costs. Gyn Oncol 1995;57:395-400.

34. Eliasson AH, Poropatich RK. Performance improvement in telemedicine: the essential elements. Milit Med 1998;163:530-35.

35. Benedet JL, Anderson GH, Matisic JP, Miller DM. A quality-control program for colposcopic practice. Obstet Gynecol 1991;78:872-75.

36. Cecchini S, Bonardi R, Grazzini G, et al. Training in colposcopy: experience with a videocolposcopy test. Tumori 1997;83:650-52.

37. Korn JE, Casey-Paal A, Lazovich D, Ball J, Slater JS. Impact of the mammography quality standards act on access in Minnesota. Public Health Rep 1997;112:142-45.

Issue
The Journal of Family Practice - 49(07)
Issue
The Journal of Family Practice - 49(07)
Page Number
623-627
Page Number
623-627
Publications
Publications
Topics
Article Type
Display Headline
The Technical Performance and Clinical Feasibility of Telecolposcopy
Display Headline
The Technical Performance and Clinical Feasibility of Telecolposcopy
Legacy Keywords
,Colposcopypatient satisfactionvaginal smearstechnology assessment, biomedical. (J Fam Pract 2000; 49:623-627)
Legacy Keywords
,Colposcopypatient satisfactionvaginal smearstechnology assessment, biomedical. (J Fam Pract 2000; 49:623-627)
Sections
Disallow All Ads
Alternative CME