Deep reinforcement learning(RL)has become one of the most popular topics in artificial intelligence research.It has been widely used in various fields,such as end-to-end control,robotic control,recommendation systems,...Deep reinforcement learning(RL)has become one of the most popular topics in artificial intelligence research.It has been widely used in various fields,such as end-to-end control,robotic control,recommendation systems,and natural language dialogue systems.In this survey,we systematically categorize the deep RL algorithms and applications,and provide a detailed review over existing deep RL algorithms by dividing them into modelbased methods,model-free methods,and advanced RL methods.We thoroughly analyze the advances including exploration,inverse RL,and transfer RL.Finally,we outline the current representative applications,and analyze four open problems for future research.展开更多
通过化学成分含量测定,比较不同加工干燥方法对白芍药材中化学成分的影响。收集安徽亳州的新鲜白芍药材,经不同加工方式(煮制、去皮)、不同干燥方式(热风、红外、微波干燥)及不同干燥温度(40、50、60、70℃)处理后,采用高效液相色谱-三...通过化学成分含量测定,比较不同加工干燥方法对白芍药材中化学成分的影响。收集安徽亳州的新鲜白芍药材,经不同加工方式(煮制、去皮)、不同干燥方式(热风、红外、微波干燥)及不同干燥温度(40、50、60、70℃)处理后,采用高效液相色谱-三重四极杆串联质谱法(ultraperformance liquid chromatography coupled to triple quadrupole with electrospray tandem mass spectrometry,UPLC-TQ-MS)技术,对白芍中单萜苷类、多酚类、鞣质及苯甲酸等11个成分进行含量测定。利用偏最小二乘判别分析(partial least squares discriminant analysis,PLS-DA)及正交偏最小二乘判别分析(orthogonal partial least squares discriminant analysis,OPLS-DA)模型对不同加工干燥后样品化学成分含量进行分析,并通过阈值(variable important in projection,VIP)图评价差异成分贡献率。结果显示,煮制前后、去皮前后及不同干燥方式后的样品均能区分开,芍药内酯苷、没食子酸、五没食子酰葡萄糖及苯甲酸为煮制后的共有差异成分;苯甲酸为去皮后的共有差异成分;没食子酸为不同干燥方式下的共有差异成分;不同温度干燥后,样品不能区分开,没有共有差异成分。该研究可为白芍药材产地干燥加工方法的选择及工艺参数的优化提供参考。展开更多
Background In recent years, interventional tumor therapy, involving implantation of intra-cholangial metal stents through percutaneous trans-hepatic punctures, has provided a new method for treating cholangiocarcinoma...Background In recent years, interventional tumor therapy, involving implantation of intra-cholangial metal stents through percutaneous trans-hepatic punctures, has provided a new method for treating cholangiocarcinoma, ^103Pd cholangial radioactive stents can concentrate high radioactive dosages into the malignant tumors and kill tumor cells effectively, in order to prevent re-stenosis of the lumen caused by a relapsed tumor. The aim of the present study was to investigate the efficacy of y-rays released by the ^103pd biliary duct radioactive stent in treating cholangiocarcinoma via induction of biliary cholangiocarcinoma cell apoptosis. Methods A group of biliary duct cancer cells was collectively treated with a dose of y-rays. Cells were then examined by the 3-（4,5-dimethyl thiazol-2-yl）-2,5-diphenyl terazolium-bromide （MTF） technique for determining the inhibition rate of the biliary duct cancer cells, as well as with other methods including electron microscopy, DNA agarose gel electrophoresis, and flow cytometry were applied for the evaluation of their morphological and biochemical characteristics. The growth curve and the growth inhibition rate of the cells were determined, and the changes in the ultrastructure of the cholangiocarcinoma cells and the DNA electrophoresis bands were examined under a UV-lamp. Results The y-ray released by ^103Pd inhibited cholangiocarcinoma cell growth, as demonstrated when the growth rate of the cells was stunned by a y-ray with a dosage larger than 197.321 MBq. Typical features of cholangiocarcinoma cell apoptosis were observed in the 197.321 MBq dosage group, while cell necrosis was observed when irradiated by a dosage above 245.865 MBq. DNA agarose gel electrophoresis results were different between the 197.321 MBq irradiation dosage group, the 245.865 MBq irradiation dosage group, and the control group. Conclusions ^103pd radioactive stents which provide a radioactive dosage of 197.321 MBq are effective in the treatment of cholangiocaminoma; ^103pd radioactive stent展开更多
Acute liver failure(ALF)is an uncommon but dramatic clinical syndrome characterized by hepatic encephalopathy and a bleeding tendency due to abrupt loss of liver function caused by massive or submassive liver necrosis...Acute liver failure(ALF)is an uncommon but dramatic clinical syndrome characterized by hepatic encephalopathy and a bleeding tendency due to abrupt loss of liver function caused by massive or submassive liver necrosis in a patient with a previously healthy liver.The causes of ALF encompass a wide variety of toxic,viral,metabolic,vascular and autoimmune insults to the liver,and identifying the correct cause can be difficult or even impossible.Many patients with ALF develop a cascade of serious complications involving almost every organ system,and death is mostly due to multi-organ failure,hemorrhage,infection,and intracranial hypertension.Fortunately,the outcome of ALF has been improved in the last 3 decades through the specific treatment for the disease of certain etiology,and the advanced intensive care management.For most severely affected patients who fail to recover after treatment,rapid evaluation for transfer to a transplantation center and consideration for liver transplantation is mandatory so that transplantation can be applied before contraindications develop.This review focuses on the recent advances in the understanding of various contributing etiologies,the administration of etiology-specific treatment to alleviate the liver injury,and the management of complications(e.g.,encephalopathy,coagulopathy,cardiovascular instability,respiratory failure,renal failure,sepsis and metabolic disturbance)in patients with ALF.Assessment of the need for liver transplantation is also presented.展开更多
The selective removal of arsenic from arsenic-bearing dust containing Pb and Sb in alkaline solution was studied. The influence of Na OH concentration, temperature, leaching time, liquid to solid ratio, and the presen...The selective removal of arsenic from arsenic-bearing dust containing Pb and Sb in alkaline solution was studied. The influence of Na OH concentration, temperature, leaching time, liquid to solid ratio, and the presence of elemental sulfur on the dissolution of As, Sb and Pb in Na OH solution was investigated. The results indicate that the presence of elemental sulfur can effectively prevent leaching of lead and antimony from arsenic. The Sb2O3, As2O3 and Pb5(AsO4)3 OH in the raw material convert to NaSb(OH)6 and PbS in the leaching residue, while arsenic is leached out as As(Ⅲ) or As(Ⅴ) ions in the leaching solution. Arsenic leaching efficiency of 99.84% can be achieved under the optimized conditions, while 97.82% of Sb and 99.97% of Pb remain in the leach residue with the arsenic concentration of less than 0.1%. A novel route is presented for the selective removal of arsenic and potential recycle of lead and antimony from the arsenic-bearing dust leached by Na OH solutions with the addition of elemental sulfur.展开更多
基金Project supported by the National Natural Science Foundation of China(Nos.61772541,61872376,and 61932001)。
文摘Deep reinforcement learning(RL)has become one of the most popular topics in artificial intelligence research.It has been widely used in various fields,such as end-to-end control,robotic control,recommendation systems,and natural language dialogue systems.In this survey,we systematically categorize the deep RL algorithms and applications,and provide a detailed review over existing deep RL algorithms by dividing them into modelbased methods,model-free methods,and advanced RL methods.We thoroughly analyze the advances including exploration,inverse RL,and transfer RL.Finally,we outline the current representative applications,and analyze four open problems for future research.
文摘通过化学成分含量测定,比较不同加工干燥方法对白芍药材中化学成分的影响。收集安徽亳州的新鲜白芍药材,经不同加工方式(煮制、去皮)、不同干燥方式(热风、红外、微波干燥)及不同干燥温度(40、50、60、70℃)处理后,采用高效液相色谱-三重四极杆串联质谱法(ultraperformance liquid chromatography coupled to triple quadrupole with electrospray tandem mass spectrometry,UPLC-TQ-MS)技术,对白芍中单萜苷类、多酚类、鞣质及苯甲酸等11个成分进行含量测定。利用偏最小二乘判别分析(partial least squares discriminant analysis,PLS-DA)及正交偏最小二乘判别分析(orthogonal partial least squares discriminant analysis,OPLS-DA)模型对不同加工干燥后样品化学成分含量进行分析,并通过阈值(variable important in projection,VIP)图评价差异成分贡献率。结果显示,煮制前后、去皮前后及不同干燥方式后的样品均能区分开,芍药内酯苷、没食子酸、五没食子酰葡萄糖及苯甲酸为煮制后的共有差异成分;苯甲酸为去皮后的共有差异成分;没食子酸为不同干燥方式下的共有差异成分;不同温度干燥后,样品不能区分开,没有共有差异成分。该研究可为白芍药材产地干燥加工方法的选择及工艺参数的优化提供参考。
文摘Background In recent years, interventional tumor therapy, involving implantation of intra-cholangial metal stents through percutaneous trans-hepatic punctures, has provided a new method for treating cholangiocarcinoma, ^103Pd cholangial radioactive stents can concentrate high radioactive dosages into the malignant tumors and kill tumor cells effectively, in order to prevent re-stenosis of the lumen caused by a relapsed tumor. The aim of the present study was to investigate the efficacy of y-rays released by the ^103pd biliary duct radioactive stent in treating cholangiocarcinoma via induction of biliary cholangiocarcinoma cell apoptosis. Methods A group of biliary duct cancer cells was collectively treated with a dose of y-rays. Cells were then examined by the 3-（4,5-dimethyl thiazol-2-yl）-2,5-diphenyl terazolium-bromide （MTF） technique for determining the inhibition rate of the biliary duct cancer cells, as well as with other methods including electron microscopy, DNA agarose gel electrophoresis, and flow cytometry were applied for the evaluation of their morphological and biochemical characteristics. The growth curve and the growth inhibition rate of the cells were determined, and the changes in the ultrastructure of the cholangiocarcinoma cells and the DNA electrophoresis bands were examined under a UV-lamp. Results The y-ray released by ^103Pd inhibited cholangiocarcinoma cell growth, as demonstrated when the growth rate of the cells was stunned by a y-ray with a dosage larger than 197.321 MBq. Typical features of cholangiocarcinoma cell apoptosis were observed in the 197.321 MBq dosage group, while cell necrosis was observed when irradiated by a dosage above 245.865 MBq. DNA agarose gel electrophoresis results were different between the 197.321 MBq irradiation dosage group, the 245.865 MBq irradiation dosage group, and the control group. Conclusions ^103pd radioactive stents which provide a radioactive dosage of 197.321 MBq are effective in the treatment of cholangiocaminoma; ^103pd radioactive stent
基金Supported by National Natural Science Foundation of China,No.81130035the National Basic Research Program of China,No.2012CB518102
文摘Acute liver failure(ALF)is an uncommon but dramatic clinical syndrome characterized by hepatic encephalopathy and a bleeding tendency due to abrupt loss of liver function caused by massive or submassive liver necrosis in a patient with a previously healthy liver.The causes of ALF encompass a wide variety of toxic,viral,metabolic,vascular and autoimmune insults to the liver,and identifying the correct cause can be difficult or even impossible.Many patients with ALF develop a cascade of serious complications involving almost every organ system,and death is mostly due to multi-organ failure,hemorrhage,infection,and intracranial hypertension.Fortunately,the outcome of ALF has been improved in the last 3 decades through the specific treatment for the disease of certain etiology,and the advanced intensive care management.For most severely affected patients who fail to recover after treatment,rapid evaluation for transfer to a transplantation center and consideration for liver transplantation is mandatory so that transplantation can be applied before contraindications develop.This review focuses on the recent advances in the understanding of various contributing etiologies,the administration of etiology-specific treatment to alleviate the liver injury,and the management of complications(e.g.,encephalopathy,coagulopathy,cardiovascular instability,respiratory failure,renal failure,sepsis and metabolic disturbance)in patients with ALF.Assessment of the need for liver transplantation is also presented.
基金Project(51604303) supported by the National Natural Science Foundation of ChinaProject(2019JJ20031) supported by the Hunan Natural Science Fund for Distinguished Young Scholar,China
文摘The selective removal of arsenic from arsenic-bearing dust containing Pb and Sb in alkaline solution was studied. The influence of Na OH concentration, temperature, leaching time, liquid to solid ratio, and the presence of elemental sulfur on the dissolution of As, Sb and Pb in Na OH solution was investigated. The results indicate that the presence of elemental sulfur can effectively prevent leaching of lead and antimony from arsenic. The Sb2O3, As2O3 and Pb5(AsO4)3 OH in the raw material convert to NaSb(OH)6 and PbS in the leaching residue, while arsenic is leached out as As(Ⅲ) or As(Ⅴ) ions in the leaching solution. Arsenic leaching efficiency of 99.84% can be achieved under the optimized conditions, while 97.82% of Sb and 99.97% of Pb remain in the leach residue with the arsenic concentration of less than 0.1%. A novel route is presented for the selective removal of arsenic and potential recycle of lead and antimony from the arsenic-bearing dust leached by Na OH solutions with the addition of elemental sulfur.
