scholarly journals Low Pre-Test Probability Scores Are Not Sufficient to Exclude Heparin-Induced Thrombocytopenia in Critically Ill Patients

Blood ◽  
2015 ◽  
Vol 126 (23) ◽  
pp. 3256-3256
Author(s):  
Noppacharn Uaprasert ◽  
Benjaporn Akkawat ◽  
Rattaporn Vichitratchaneekorn ◽  
Chantiya Chanswangphuwana ◽  
Ponlapat Rojnuckarin

Abstract Background: Heparin-induced thrombocytopenia (HIT) is a serious complication of heparin administration. Diagnosis of HIT is a clinical challenge. The 4Ts scoring model (0-3 low, 4-5 intermediate, 6-8 high probability of HIT) has been validated in several studies including the recent meta-analysis (Blood 2012;120:4160-7), which demonstrated that a low probability 4Ts score conferred a high negative predictive value (0.998; 95% CI, 0.970-1.000) for excluding HIT. Some experts propose a diagnostic approach for HIT based on the 4Ts scoring model and exclude HIT in patients with a low probability score without serologic testing for HIT. Another recently constructed model 'HIT expert probability' (HEP) score (< 2 unlikely, ≥ 2 likely) demonstrated better diagnostic performance in mainly surgical patients. However, in critically ill patients who receive heparin, other concomitant causes of thrombocytopenia are common and may interfere with clinically diagnosis of HIT. In this study, we aimed to determine the diagnostic accuracy of the 4Ts and the HEP score for excluding HIT in a population of critically ill patients. Methods: Consecutive patients admitted in critical care units during 2006-2015 were included in this study. Clinical and laboratory data of individuals were retrospectively reviewed from medical records. The 4Ts and the HEP score were blindly computed by two independent reviewers (NU and RV). The rapid particle gel immunoassay (platelet factor 4/heparin-PaGIA) was used for HIT screening. Subjects yielding positive PaGIA were sent for the confirmatory testing using the in-house platelet aggregometry measuring heparin-induced platelet aggregation (HPA). However, during the shortage of PaGIA, HPA was performed in all cases. HPA using platelet-rich plasma from healthy donors with known reactive platelets was performed as previously described with a few modification. Aggregation values of at least 20% above negative controls in the presence of 0.5 or 1.0 U/ml of heparin, which were subsequently inhibited by the addition of 100 U/ml of heparin, were defined as positive results. Results: There were 92 critically ill patients with suspected for HIT. Among them, 56 (60.9%), 33 (35.9%) and 3 (3.3%) yielded low, intermediate and high probability 4Ts score, respectively, while 33 (35.9%) and 59 (64.1%) yielded unlikely and likely high probability HEP score, respectively. Of 78 with obtainable PaGIA, 25 cases (37.2%; 6/6 HPA+ and 19/72 HPA-) yielded positive results. Eleven patients (12.0%) yielded positive results for HPA were diagnosed as HIT. There were 6 (54.5%) developing thrombosis (4 new proven and 2 progressive). Clinical data of all documented HIT were summarized in the table 1. Documented HIT was diagnosed in 5.4%, 18.2% and 66.7% of low, intermediate and high probability 4Ts score, respectively, whereas HIT was demonstrated in 9.4% and14.3% of unlikely and likely probability HEP score, respectively. The receiver operating characteristic curve analysis demonstrated that the 4Ts score was tended to display better diagnostic performance than the HEP score with the area under curve of 0.740 and 0.587 (P = 0.053), respectively. The HIT cases with low pre-test probability scores were due to concomitant causes of thrombocytopenia resulting in earlier onset, lower nadir of platelet counts and/or more minus scores from alternative etiologies of thrombocytopenia. Conclusions: The diagnostic performance of the 4Ts and the HEP score is limited in complicated and/or critically ill patients due to multiple etiologies affecting onset and severity of thrombocytopenia. Both low probability 4Ts score and unlikely HEP score are unsafe for excluding HIT in this patient group. Table 1. Clinical characteristics of patients documented heparin-induced thrombocytopenia Case Age (years)/ sex Patient type Heparin type Thrombosis PaGIA 4Ts score HEP score 1 61/ M CVT UFH New + 2 -6 2 37/ M CCU UFH, LMWH Progressive NA 3 -3 3 74/ F CVT UFH No NA 3 3 4 83/ M GenS UFH, LMWH New + 4 -6 5 80/ F Med LMWH No + 4 6 6 62/ M CCU UFH No NA 5 4 7 51/ M CCU UFH No NA 5 5 8 80/ M Med UFH No + 5 6 9 76/ M CCU UFH Progressive NA 5 10 10 50/ F Med UFH, LMWH New + 6 5 11 87/ M CCU UFH New + 7 9 M: male, F: female, CVT: cardiovascular thoracic surgery, CCU: coronary care unit, GenS: general surgery, Med: medicine, UFH: unfractionated heparin, LMWH: low molecular weight heparin, NA: not available Disclosures No relevant conflicts of interest to declare.

Blood ◽  
2018 ◽  
Vol 132 (Supplement 1) ◽  
pp. 4988-4988
Author(s):  
Phyo Thazin Myint ◽  
Amani Erra ◽  
Taha Alrifai ◽  
Salman Syed ◽  
Bibek Singh Pannu ◽  
...  

Abstract Introduction: Thrombocytopenia is a common occurrence in critically ill patients and results in an array of diagnostic workup. Heparin induced thrombocytopenia (HIT) is one of the most frequently ordered tests in this scenario, although it is a less common cause (0.02-0.5%) The over testing and treatment of HIT in Intensive Care Unit (ICU) can lead to a change in medications, and result in side effects, increased ICU length of stay and increased costs. Current guidelines recommend 4-Ts criteria to evaluate the clinical HIT probability in general population, but it may also be used in Intensive Care Unit (ICU) patients. Here, we want to analyze the the usage of 4Ts score in a community hospital and to understand its correlation with HIT testing to see if HIT testing could have been avoided. Methods: We performed a retrospective chart review of adult patients who underwent testing for Heparin Induced Thrombocytopenia anti-platelet factor 4 antibody (anti- PF4 Ab) in ICU at our institution from 03/01/2012 to 02/01/2018. The primary outcomes were set to identify (1) the extent of inappropriate of HIT testing and its consequences in patients with low 4Ts scores, and (2) if 4Ts score as a potential predictor of length of stay and mortality in ICU. As a secondary outcome, we assessed if Body Mass Index (BMI) and Recent Surgery are related to false positive anti-PF4 Ab test. Kruskal-Wallis test and Fisher Exact test were used. Results: A total of 66 patients were identified. The mean age was 64 yr and the male-female ratio was similar. 40 patients had recent surgery in the past 3 months. The cause of thrombocytopenia other than HIT was possible or definite in 62 patients with sepsis being the most common cause (56.45%). 30 patients had low probability 4-Ts scores, 28 had intermediate and 7 had high probability. HIT was confirmed (Serotonin Release Assay-SRA positive) in 0%, 7.14% and 12.5% of patients with low, intermediate and high probability 4Ts scores, respectively. In the patients with low probability 4Ts and anti-PF4 Ab testing, heparin was held in 24 (80%) and the anti-coagulation was switched (to either fondaparinux or argatroban) in 10 (33.33%). In those patients with anticoagulation switch, 3 had minor bleeding. There was no difference in the ICU length of stay (p=0.1712) and mortality (p=0.149) between patients with low, intermediate and high probability 4Ts scores. Patients with BMI ≥40 kg/m2 had twice the percentage of false positive anti-PF4 Ab testing compared with the rest, but the results were not significant (p=0.285). Recent surgery was not related to the false positive anti-PF4 Ab testing (p=1). Conclusion: As no patient with low-probability 4Ts score had confirmed HIT, low 4Ts may be a good estimator of the unlikeliness of HIT even in critically ill patients. We found discrepancy in the recommendations and usage of Anti-PF4 Ab testing in our institution. This has resulted in switching of heparin to other, more expensive anti-coagulations. This may very well be the situation in many other similar institutions. This could partly be due to lack of awareness of HIT testing guidelines in the critical care setting. We recommend the use of 4Ts scoring and more sensible testing and treatment of HIT in ICU patients. Although we could not demonstrate the statistical association between morbid obesity and false positive anti-PF4 Ab, our study might have been underpowered by low subgroup population of such patients. We propose further studies about HIT testing and treatment to include morbidly obese patients as a separate sub-group. Disclosures No relevant conflicts of interest to declare.


Blood ◽  
2006 ◽  
Vol 108 (11) ◽  
pp. 1051-1051 ◽  
Author(s):  
John L. Francis ◽  
Alane Drexler ◽  
Mary Kathryn Duncan ◽  
Hina Desai ◽  
Mildred Amaya ◽  
...  

Abstract The laboratory diagnosis of heparin-induced thrombocytopenia (HIT) relies on the demonstration of antibodies to the heparin-platelet factor 4 (H-PF4) complex. Assays are based on the functional ability of H-PF4 antibodies to activate platelets, or detect the antibody directly by immunological methods. Multiple assays in each category are currently in clinical use and newer, rapid immunological assays are becoming available. The aim of this study was to compare available methods for detecting H-PF4 antibodies in a prospective study of patients with clinically suspected HIT. Functional assessment included serotonin release assay (SRA) and lumi-aggregometry (LA). Immunological assessment included ELISA (GTI), and particle gel immunoassay (PGIA; Diamed and Akers). Circulating platelet microparticles (PMP) were assessed by flow cytometry. Patients were also assessed for the pre-test probability of HIT using the Warkentin 4-T scoring system. 151 patients were enrolled. 54/151 patients (35.8%) had a positive GTI ELISA, while 53/151 (35.1%) and 39/151 (25.8%), respectively, had positive Akers and Diamed PGAI tests. Only 15/149 (10.1%) patients had a positive SRA, while only 5/150 (3.3%) gave a positive result by lumi-aggregometry. There was a strong correlation between the ELISA OD values obtained in serum and plasma using both fresh (r=0.98) and frozen (r=0.99) samples, although slightly more positive results were obtained using serum. Differences were only seen with OD values around the cut-off of 0.4. The majority (77.8%) of H-PF4 antibodies detected by ELISA were neutralized by heparin in the ‘confirmatory’ procedure. Weak antibodies (OD 0.4–0.5) were more likely to be non-neutralizable (5/12; 42%) than strong antibodies (OD&gt;1.0; 4/23; 17%). 47 patients positive by ELISA were retested to determine the predominant immunoglobulin subclass. 15/47 (32%) were positive (OD&gt;0.4) for IgG; 27/47 (57%) for IgM, and 12/47 (25%) for IgA. The Diamed assay more closely correlated with the GTI ELISA than the Akers test (82.1% vs. 56.7%, respectively). The PGIAs were only moderately correlated with each other (64%) with the Akers assay giving more “false positive” results relative to the ELISA. PMP were higher in patients with a positive ELISA (6.2 vs 4.7 × 106/ml) or positive SRA (5.5 vs. 5.1 ×106/ml) but this was not statistically significant due to the wide range of results. Of 119 patients assessed, 87 had a low pre-test probability of HIT (4-T score 0–3), 27 had an intermediate probability (4–5), and 5 had a high probability (6–8). The GTI ELISA was positive in 24, 56 and 80% of low, intermediate and high probability cases. The Akers PGIA was positive in 39, 41 and 40% respectively; the Diamed assay in 21, 33 and 40%, and the SRA in 7, 11 and 40%, respectively. This study was conducted in a patient population biased towards cardiovascular surgery, and confirms previously reported observations that immunoassays are more frequently positive than functional assays. The ELISA correlated better than the PGIA tests with the pre-test probability of HIT, although the Diamed test showed acceptable correlation with the ELISA. In contrast, the Akers assay correlated poorly with the ELISA, often producing positive results when the latter test was negative. We conclude that while the PGIA tests are rapid and convenient, further studies are needed to determine the basis for disparate results relative to the widely used ELISA.


Blood ◽  
2019 ◽  
Vol 134 (Supplement_1) ◽  
pp. 3462-3462 ◽  
Author(s):  
Somedeb Ball ◽  
Nimesh Adhikari ◽  
Anita Sultan ◽  
Kyaw Zin Thein ◽  
Khatrina Swarup ◽  
...  

Introduction: Heparin induced thrombocytopenia (HIT) is a serious prothrombotic condition, usually triggered by exposure to heparin products with formation of antibodies to platelet factor 4/ heparin polyanion complexes. Diagnostic algorithm for HIT combines clinical scoring (4T score) with time sensitive screening for HIT antibodies (HIT-ab), while serotonin release assay (SRA) is remains the gold standard for confirmatory diagnosis. The rate of utilization of 4T score was low in our institution, resulting in inappropriate orders for HIT-Ab test and subsequent administration of unnecessary alternative anticoagulation (AC) in patients with false positive results. In this project, we designed a structured HIT diagnostic workflow incorporating 4T score calculation in our electronic medical record (EMR) and replaced particle immunofiltration assay (PIFA) with latex immunoturbidometric assay (LIA) in our laboratory for HIT-Ab screening, with an aim to improve the rate of 4T utilization and accuracy of HIT diagnosis in a cost-efficient manner. Methods: In phase I, we performed a retrospective chart review of all patients with PIFA ordered between March 2017-March 2018. Two investigators independently calculated 4T, collected data on results of HIT-Ab, confirmatory SRA tests, and the duration of alternative AC from each record. Any variations in 4T score were resolved by a senior investigator. In phase II, we implemented a new workflow in the EMR incorporating mandatory calculation of 4T score with every order for HIT-Ab test. Our lab started using LIA in place of PIFA. Charts were reviewed on patients with HIT-Ab orders (LIA) from January-June of 2019. Results: On review of data from phase I, we noted that 4T score was documented in only 5 (0.02%) of 170 patients in whom a PIFA test was ordered. Per investigators assessment, 113 (66.4%) patients had low probability (4T ≤ 3), 47 (27.6%) had intermediate probability (4T 4 or 5), and 10 (5.8%) had a high probability (4T ≥ 6) for a diagnosis of HIT. SRA was ordered in 32 patients, although 17 of them had low probability per investigator assessment. PIFA test came back positive in 26 patients, of whom 16 had corresponding SRA results, and three samples were positive for SRA. PIFA was negative in two patients with confirmed HIT (SRA positive). A total of 19 patients received alternate AC in the first phase, 7 of them had low 4T score per our assessment. In phase II, 69 records were found with available LIA results, showing a relative decrease in HIT-Ab orders compared to earlier phase at the six months mark. Documentation of 4T score has been 100% by ordering physicians, a certain improvement from phase I. Investigator calculated 4T score showed low probability in 33 (47.8%) patients, intermediate probability in 31 (44.9%) patients, high probability in 5 (0.07%) patients. LIA was positive in 7 of the 69 ordered tests, 6 of whom scored high/intermediate in the 4T score. HIT diagnosis was confirmed in 3 of these 7 patients with a positive SRA result. During this period, all the 7 of the eight patients who received alternate AC had a high or intermediate probability for HIT as per 4T. Conclusion: Our study demonstrated that the successful implementation of a structured protocol for HIT diagnosis ensured 100% adherence to the calculation and documentation of 4T score by clinicians, and significantly reduced the number of inappropriate HIT-Ab test orders in our institution. Use of alternate AC was also more consistent with the level of probability for HIT. Table Disclosures No relevant conflicts of interest to declare.


2011 ◽  
Vol 106 (12) ◽  
pp. 1197-1202 ◽  
Author(s):  
Jakob Hesberg ◽  
Sentot Santoso ◽  
Gregor Bein ◽  
Tamam Bakchoul ◽  
Ulrich Sachs

SummaryHeparin-induced thrombocytopenia (HIT) is an adverse complication of heparin caused by HIT antibodies (abs) that recognise platelet factor 4-heparin (PF4/hep) complexes. Several laboratory tests are available for the confirmation and/or refutation of HIT. A reliable and rapid singlesample test is still pending. It was the objective of this study to evaluate a new lateral-flow immunoassay based on nanoparticle technology. A cohort of 452 surgical and medical patients suspected of having HIT was evaluated. All samples were tested in two IgG-specific ELISAs, in a particle gel immunoassay (PaGIA) and in a newly developed lateral-flow immunoassay (LFI-HIT) as well as in a functional test (HIPA). Clinical pre-test probability was determined using 4T's score. Platelet-activating antibodies were present in 34/452 patients, all of whom had intermediate to high clinical probability. PF4/hep abs were detected in 79, 87, 86, and 63 sera using the four different immunoassays. The negative predictive values (NPV) were 100% for both ELISA tests and LFI-HIT but only 99.2% for PaGIA. There were less false positives (n=29) in the LFI-HIT compared to any other test. Additionally, significantly less time was required to perform LFI-HIT than to perform the other immunoassays. In conclusion, a newly developed lateral-flow assay, LFI-HIT, was capable of identifying all HIT patients in a cohort in a short period of time. Beside an NPV of 100%, the rate of false-positive signals is significantly lower with LFI-HIT than with other immunoassay(s). These performance characteristics suggest a high potency in reducing the risk and costs in patients suspected of having HIT.


2019 ◽  
Vol 152 (Supplement_1) ◽  
pp. S30-S30
Author(s):  
Christina Pierre ◽  
Mary Acker ◽  
Surabhi Palkimas ◽  
Lindsay Bazydlo

Abstract Background Heparin-induced thrombocytopenia (HIT) is an immune-mediated, adverse reaction to heparin in which heparin binds platelet factor 4 (PF4), triggering the development of heparin-PF4 antibodies (HITAb). HITAbs bind and activate platelets, causing thrombosis, platelet consumption, and thrombocytopenia. Heparin is replaced with relatively costly nonheparin anticoagulants until HIT can be ruled out. HIT diagnosis consists of a HITAb immunoassay with reflex to a serotonin release assay (SRA) for confirmation of positive results. Recently, a fully automated latex immunoturbidimetric assay (LIA) for detection of HITAbs received FDA clearance. We sought to verify the performance characteristics of the LIA with the aim of implementing the test in a high-volume university hospital laboratory. Methods The in-house HITAb LIA was performed on the Instrumentation Laboratory TOP700 analyzer using HemosIL HIT-Ab(PF4-H) reagent. The comparator method, a HITAb ELISA, was performed at a reference laboratory with positive results reflexed to SRA. All samples (36 total) sent to the reference laboratory for HIT testing from December 2017 to November 2018 were aliquoted and run in parallel by LIA. Intra-assay precision was assessed by running manufacturer-provided low and high control samples 10 times in succession, while interassay precision was assessed by running low and high samples every day for 10 days. Turnaround time to HITAb result was retrieved from the electronic medical records for HIT testing performed 60 days before and after in-house test implementation. Results The agreement between the LIA and ELISA was 92% (33/36). One discordant sample tested negative by ELISA and was not assessed by SRA. Another tested positive by ELISA and negative by LIA and was confirmed negative by SRA. The final discordant sample tested negative by LIA but positive by ELISA and was confirmed positive by SRA. Thirty-three percent (12/36) of samples tested positive for HITAb by ELISA and were reflexed to SRA. Both the ELISA and LIA showed 83% agreement (10/12) with the SRA. The coefficient of variance (CV) for the intra-assay precision studies was 18% and 5% for the low and high controls, respectively. The CV for the interassay precision studies was 28% and 5% for the low and high controls, respectively. Postimplementation quality control data revealed 61% and 20% imprecision on the low and high level controls, respectively, which declined significantly when reagents were removed from the instrument and refrigerated within 2 hours. The turnaround time for HITAb results was reduced by 74% (10.5 vs 41 hours) after in-house test implementation, significantly reducing the need for administration of nonheparin anticoagulants. Conclusion The LIA and ELISA methods compared favorably, allowing for clinical implementation of the LIA. The shortened turnaround time of the LIA significantly reduced the time to rule out HIT, enhancing patient care and reducing drug costs. The assay imprecision warrants further investigation regarding reagent stability.


Blood ◽  
2008 ◽  
Vol 112 (11) ◽  
pp. 1244-1244
Author(s):  
Kirsty M Cuthill ◽  
Andrew Retter ◽  
David A Gurney ◽  
Gary W Moore

Abstract Background: Heparin induced thrombocytopenia (HIT) is a prothrombotic adverse drug reaction to heparin. The 4T scoring system is a well validated system for assessing the pre-test probability of HIT and has a high negative predictive value for excluding HIT in most clinical situations, however, only a minority of patients have been evaluated in the ICU setting. The critically ill pose different challenges when compared with other medical and surgical patients. They have increased rates of thrombotic and haemorrhagic complications. Thrombocytopenia is reported in approximately 30–50%. We examined our ICU experience to evaluate the pairing of the 4T scoring system and EIA-GTI PF4 ELISA assay to evaluate their diagnostic accuracy in confirming a diagnosis of HIT in the acute setting. The gold standard measure is the serotonin release assay (SRA), but this is not routinely available in the UK. Methods: This single centre, retrospective, observational study involved reviewing the records of 75 consecutive patients investigated for HIT on our ICU from February 2006 to April 2008. We follow the British Society of Haematology guidelines for the management of HIT. Initial testing is with the EIA-GTI PF4 assay (positive if &gt;0.4 OD) coupled with a heparin induced platelet activation assay (HIPA). Results: During the 26 months studied, 3.5% of ICU admissions were screened for HIT. A diagnosis of HIT, defined in this study as an intermediate or high 4T pre-test probability score and an ELISA result &gt;0.7 OD was present in 0.46%. 45% of patients were medical, 40% had cardiothoracic surgery, the remaining 15% were general surgical patients. 66% had three or more organ failure, 70% received haemofiltration. Severe sepsis and haemofiltration were alternative causes of thrombocytopenia in 97% of patients. The 4T’s were used to risk stratify patients, 68% of patients had a low score, 29% were at intermediate risk and 3% had a high probability of HIT. 76% of patients with a low pre test probability had a negative ELISA and none developed a thrombosis. 4 (8%) patients with a low pre-test probability had a positive ELISA with an optical density &gt;0.7 OD. 4 patients had a low pre-test probability but a positive ELISA, none of whom developed a thrombus. 2 patients had a positive ELISA and a positive HIPA, both had an intermediate pre-test probability. 1 patient had a negative ELISA (&lt;0.4 OD) in the context of a high pre-test probability, he became thrombocytopenic on repeated heparin exposure. There was no correlation between a high pre-test probability and the magnitude of the ELISA result. 10 patients were treated with lepirudin, 2 developed haemorrhage requiring interruption of anticoagulation and transfusion. Discussion: The incidence of HIT recorded over the 26 month study period at GSTT is similar to the incidence of 0.3 -0.5% reported by Selleng. No diagnoses of HIT were missed after increasing our ELISA threshold from 0.4 - 0.7 OD. Neither the 4T pre-test probability nor the EIA GTI PF4 ELISA alone are sufficient to exclude a diagnosis of HIT. The 4T scoring system although well validated system may not work as well in the critically ill. The high prevalence of thrombocytopenia and alternative causes of thrombocytopenia mean the presence of thrombosis and the timing of the thrombocytopenia post heparin exposure are the major discerning features. Lo has previously reported the potential to over diagnose HIT by 100% when using the EIAGTI ELISA (Lo GK. Am J Hematol.2007; 82: 1037–43). The positive ELISA results in those patients with a low pre-test probability may be false positives secondary to cross-reacting autoantibodies. The high prevalence of acute renal failure highlights the importance of making an accurate diagnosis of HIT. Use of lepirudin in renal failure is associated with an increased risk of haemorrhage. We use 10% of the standard dose in patients with renal failure, haemorrhage occurred despite intensive monitoring in 20% of the patients. Our study is limited by its retrospective design and the lack of SRA testing. We recommend that both tests are performed in patients at risk of HIT. Increasing the positive ELISA threshold to 0.7 OD improves the specificity of the ELISA for detecting clinically significant heparin/PF4 antibodies in critically ill patients.


Author(s):  
Hans-Jürgen Kolde ◽  
Ralf Dostatni ◽  
Susanne Mauracher

AbstractThe exclusion of heparin induced thrombocytopenia (HIT) is required for selecting the most appropriate anticoagulation therapy in affected patients. It requires the combination of clinical data with the detection of antibodies directed against platelet factor 4 (PF4) in complex with polyanions (PA) such as heparin.We developed a lateral flow immunoassay (LFIA) for PF4/PA complex specific IgG antibodies based on gold nanoparticles. Unlike most other assays, the initial immune reaction takes place in the liquid phase. The sensitivity of the assay has been adjusted with clinical samples aiming in the reliable detection of sera which are positive in a functional platelet activation assay.Sera from 60 patients with suspected HIT were investigated. LFIA identified correctly all samples (n=20) which were positive in a functional assay (HIPA) and an IgG specific ELISA. It correlated with ELISA, but false positive results were less frequent (7 samples were negative with LFIA and HIPA but positive with ELISA).The LFIA may be a suitable tool for the rapid exclusion of HIT within 10 min.


Mycoses ◽  
2011 ◽  
Vol 55 (3) ◽  
pp. 228-236 ◽  
Author(s):  
Gino G. Tapia ◽  
Raymund R. Razonable ◽  
Jeanette E. Eckel-Passow ◽  
Brian D. Lahr ◽  
Bekele Afessa ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document