Accuracy assessment of a PION TCI pump based on international standards
Article information
Abstract
Background:
Inaccuracies associated with target-controlled infusion (TCI) delivery systems are attributable to both software and hardware issues, as well as pharmacokinetic variability. However, little is known about the inaccuracy of the syringe pump operating in TCI mode. This study aimed to evaluate the accuracy of the TCI pump based on international standards.
Methods:
A test apparatus for accuracy evaluation of a syringe pump (PION TCI®, Bionet Co. Ltd.) was designed to apply the gravimetric method. Pump accuracy was evaluated in terms of deviation defined by the following equation: infusion rate deviation (%) = (Ratemea − Rateest) / Rateest × 100, where Ratemea is the infusion rate (ml/h) as measured by the gravimetric system, and Rateest is the infusion rate (ml/h) as estimated by the pump. An infusion rate representing TCI mode was determined from previous clinical trial data which evaluated the predictive performance of the pharmacokinetic model. The PION TCI pump used in that clinical trial was used to evaluate accuracy of the syringe pump. The distribution of infusion rates obtained from the clinical trial was calculated, and the median value of the distribution was determined as the representative value.
Results:
The representative infusion rate representing TCI mode was 31 ml/h, at which the infusion rate deviation was 4.5 ± 1.6%.
Conclusions:
The inaccuracy of the syringe pump contributing to TCI system inaccuracy is insignificant.
INTRODUCTION
Target-controlled infusion (TCI) is an administration method that changes the infusion rate to maintain target concentration and is currently used in anesthesia and sedation [1,2]. For an accurate target effect-site concentrationcontrolled infusion, a dedicated syringe pump with pharmacokinetic models and blood–brain equilibration rate constant (ke0) is required [3]. The pharmacokinetic model included in the TCI system consists of population typical values of each pharmacokinetic parameter and covariates describing some of the inter-individual variability [4], that is, the inter-individual variability of pharmacokinetic parameter not explained by covariates (expressed as ETA in the control stream of nonlinear mixed effects modeling) and model error (expressed as SIGMA) are not reflected in the TCI system [4,5]. For this reason, when a new pharmacokinetic model is developed, it is necessary to evaluate the accuracy of the TCI system in which the model is programmed prior to deployment in clinical practice [6]. The evaluation criteria for the overall predictive performance of the TCI system were offered by Varvel et al. [7]. Briefly, the inaccuracies associated with TCI delivery system are attributable to both software and hardware issues as well as pharmacokinetic variability. In terms of software, inaccuracies are due to errors associated with incorrect implementation of the pharmacokinetic model, which can be easily corrected. However, little is known about the inaccuracy of the syringe pump operating in TCI mode as there is no accuracy criterion for TCI mode operation of the syringe pump according to International Standards IEC 60601-2-24 [8]. Considering the recent advances in syringe pump technology, the impact of the pump on inaccuracies in the TCI delivery system may be insignificant. However, it is necessary to quantitatively evaluate the accuracy of the syringe pump.
Therefore, this study aimed to evaluate the accuracy of the syringe pump operating in TCI mode based on international standards.
MATERIALS AND METHODS
The accuracy of medical electrical equipment including volumetric or syringe pump is normally assessed by administering a test solution at a constant rate over a period of time and subsequently measuring the weight of the actually administered solution [8,9]. However, because the TCI mode can be interpreted as variable infusion rates, it is not feasible to apply the gravimetric method to a syringe pump operating in TCI mode. Nevertheless, the accuracy of a syringe pump operating in TCI mode can be assessed based on international standards if the infusion rate representing the TCI mode can be determined. In this in vitro study, we used the infusion rate representing the TCI mode, which was derived from the results of a previous study that evaluated the predictive performance of a new pharmacokinetic model [6]. The accuracy of the pump was thus evaluated using the gravimetric method based on the international standard at the predefined infusion rate. Exemption of approval for this study was granted by the institutional review board at Asan Medical Center (Seoul, Korea).
Determination of an infusion rate representing TCI mode
When a new pharmacokinetic model is developed, an external validation must be performed prior to deployment of the model in clinical practice [10]. The results of evaluating the predictive performance of a new pharmacokinetic propofol model–Choi model–for use in underweight patients during target-controlled infusion have recently been published [6]. These clinical trial data were used to determine an infusion rate representing the TCI mode in the current study [6]. A brief introduction to this clinical test method is as follows [6]. Propofol was infused with TCI syringe pump (PION TCI®, Bionet Co. Ltd., Korea), which was connected to a personal computer (PC) by an RS232c cable and controlled by TCI software (Asan pump, version 2. 1. 3, Bionet Co. Ltd., http://www.fit4nm.org/download). Plasma concentration, effectsite concentration, dose infused, and infusion rate data were recorded at 10 s intervals and stored in comma-separated values (“csv”) format. Pharmacokinetic parameters and blood–brain equilibration rate constant (ke0) of the new pharmacokinetic model were programmed into the Asan pump. The order of the target Ce values of propofol was 2.5, 3, 3.5, 4, 4.5, and 2 μg/ml, with each concentration maintained for at least 10 min after reaching pseudo-steady-state between blood and brain. The distribution of infusion rates obtained from the clinical trial was calculated, and the median value of the distribution was determined as the representative value. The PION TCI pump used in the clinical trial was used for the accuracy evaluation of syringe pump [6].
Accuracy test of a syringe pump
We constructed a test apparatus for accuracy evaluation of a TCI syringe pump (PION TCI®, Bionet Co. Ltd.) [8]. A schematic experimental setup is presented in Fig. 1. An infusion rate representing TCI mode was determined from previous clinical trial data which evaluated the predictive performance of the pharmacokinetic model [6]. Water in a syringe was infused at the representative infusion rate into a measurement beaker on the balance (XPE 206 DR, MettlerToledo, USA) with a resolution of 5 μg. To minimize liquid loss to evaporation, an evaporation trap was installed on the beaker. Pressure and temperature sensors were installed in the measurement beaker to obtain precise water density to convert water mass to volume. All measurement equipment and sensors were calibrated and had traceability to National Standards in Republic of Korea. Pressure and temperature data were collected on a laptop computer for offline analysis. After maintaining an infusion rate for at least 10 min, we observed changes in the beaker weight during a 90 s infusion, repeated 5 times with a minimum time interval of 10 min. All experiments were performed with sterile, disposable 50 ml BD infusion syringes, which are identical to the syringes used in the clinical trial [6]. Pump accuracy was evaluated in terms of deviation as defined by the following equation [8,9]:
Experimental setup for accuracy evaluation of the PION TCI pump. PC: personal computer, TCI: targetcontrolled infusion.
where, Ratemea is the infusion rate (ml/h) as measured by the gravimetric system, and Rateest is the infusion rate (ml/h) as estimated by the pump.
The Ratemea is defined by the following equation:
where, ε is the buoyancy correction factor set at 1.00105 [11], m is the mass of the collected water (g), ρ is the density of water (kg/m3), and t is elapsed time (s). The Ratemea was repeated five times and the mean value was used to calculate the infusion rate deviation. For the calculation of measurement uncertainty of Ratemea, we used uncertainty results from a previous study for the balance, long term stability, and evaporation loss [9].
Statistical analysis
Statistical analyses were conducted using R (version 3. 5. 2, R Foundation for Statistical Computing, Austria) or SigmaStat version 3. 5 for Windows (Systat Software, Inc., USA). Data are expressed as mean ± standard deviation (SD) for normally distributed continuous variables and as median (25–75%) for non-normally distributed continuous variables.
RESULTS
In this in vitro study evaluating the pump accuracy, the infusion rate representing TCI mode was derived from the 15,693 infusion rate data from a previous clinical study [6]. The frequency distribution of the infusion rate data during propofol administration using a PION TCI pump from the induction of anesthesia to the time of the last blood sampling is presented in Fig. 2. The distribution did not follow the normal distribution, and the median (25–75%) infusion rate was 31 (28–46) ml/h. Mean Ratemea (SD) was 32.4 ± 0.6 ml/h. The infusion rate deviation as calculated by the gravimetric method at the representative infusion rate was 4.5 ± 1.6%.
Frequency distribution of infusion rates during propofol administration using a PION TCI pump from the induction of anesthesia to the time of the last blood sampling. The vertical red dotted line shows median frequency. TCI: target-controlled infusion.
DISCUSSION
An infusion pump is a medical electrical (ME) device to regulate the flow of liquids into the patient under pressure generated by the pump. A syringe pump is a type of infusion pump which performs controlled infusion of liquids into the patient by one or more single action syringes. The international standard for evaluating the accuracy of ME equipment covers only four flow types of the infusion pump: continuous infusion, noncontinuous infusion, discrete delivery of a bolus, and profile pump [8]. TCI is a flow type of infusion pump but is not yet considered.
In general, the accuracy of the TCI delivery system is assessed through the difference between the target concentration (Cp) and the measured concentration (Cm), where a performance error (
In terms of pump inaccuracy, faster infusion rate and smaller size syringe lead to smaller errors induced by start-up delay in administration of the drug [16]. In a previous study, cumulative error rates of TCI pumps at 30 min after TCI initiation at plasma concentration of 0.5 μg/ml were −1% to −13% [17]. Maintaining a minimum of 10 min at a constant rate might be considered to be a relatively short time to evaluate the accuracy of the pump. Some infusion pump manufacturers include trumpet curves in their user manuals, in which the trumpet curve is defined as the maximum positive and negative percentage deviation from the expected dose relative to the time interval of infusion, for a set infusion rate [8]. The percentage error is the largest at the beginning of the administration and becomes smaller as the time for maintaining the constant rate becomes longer. After approximately 10 min, large fluctuations in the percentage error are reduced, resulting in a relatively constant error rate [8].
The accuracy of the TCI pump may be evaluated by a simulation method rather than the gravimetric method. The volume of drug administered to maintain a constant target concentration over a period of time can be calculated using nonlinear mixed effects modeling (NONMEM). However, NONEM simulations do not reflect the actual pump infusion rate nor do they consider the speed limit of 1,200 ml/h of the TCI pump. It is also impossible to comply with the international standard which stipulates that the accuracy of ME equipment should be evaluated by the gravimetric method as a gold standard. Therefore, to apply the gravimetric method, we had to derive a representative infusion rate from a previous study [6].
This study has some limitations which must be addressed. One limitation is that the infusion rate (which represents TCI mode) was not fixed to a single value. The representative infusion rate will vary with the pharmacokinetic model, the target concentration, and period over which the target concentration is maintained. In this study, the infusion rate deviation was 4.5–8.6% within the dose rate range of 29–34 ml/h, translating to a difference of ~1.5–2.6 ml/h. For propofol, this is not a dose that would cause clinically significant changes. Therefore, even if the value representing the TCI mode changes, the same result would be obtained: that the proportion of the inaccuracy of the TCI pump contributing to the inaccuracy of the TCI system is insignificant. Another limitation is that the method proposed in this study does not directly evaluate the accuracy of pumps operating in TCI mode. To date, however, there is no accuracy criterion for TCI mode operation of syringe pumps based on international standards, which is why we tried to suggest an alternative method for such evaluation. Although this method needs further improvement and adaptations, we believe that this may function as a viable method for objectively evaluating the accuracy of a pump in TCI mode.
In conclusion, the contribution of the TCI pump to the inaccuracy of the TCI system is insignificant.
ACKNOWLEDGMENTS
This study was supported by a grant (18011083) from the Korea Research Institute of Standards and Science, Daejeon, Republic of Korea, under the project “Establishment of measurement standards for medical metrology.” We thank Dr. Joon Seo Lim from the Scientific Publications Team at Asan Medical Center for his editorial assistance in preparing this manuscript.
CONFLICTS OF INTEREST
No potential conflict of interest relevant to this article was reported.
ORCID
Il Doh: https://orcid.org/0000-0002-1639-7730
Seok Hwan Lee: https://orcid.org/0000-0003-2477-365X
Yong-Hun Lee: https://orcid.org/0000-0002-1724-7996
Bokyoung Jeon: https://orcid.org/0000-0003-3280-8429
Gyu-Jeong Noh: https://orcid.org/0000-0002-1964-9294