본 논문은 보편적으로 복잡한 문제로 정의되던 테트리스 게임을 강화학습을 통해 해결하기 위한 아키텍처를 구현하였다. 테트리스 게임은 무작위로 나타나는 블록의 모양과 회전의 형태를 고려해서 블록을 최적의 위치에 신속하게 쌓아야 하므로, actor의 빠른 판단능력과 반응속도를 요구한다. 또한, 다양한 블록의 형태와 순서로 인해 매우 많은 경우의 수가 나타나기 때문에 수행의 주체가 사람이라면 단순히 기억력과 암기에 의존하는 방법으로는 수행에 한계가 있다. 따라서 본 연구에서 구현한 강화학습 아키텍처의 경우 학습 모델의 구현뿐 아니라 의사결정의 정확성을 높일 수 있는 휴리스틱을 보상에 가중치로 활용하는 방식으로 접목하였고, 그 결과 사람이 직접 게임을 수행하는 것에 비해 보편적으로 높은 점수를 얻을 수 있었다. 아직은 해당 분야를 완전히 정복하였다고 표현할 수는 없지만, 여러 번의 실험에서도 일반적인 사람에 비해서 더욱 좋은 플레이를 할 수 있었다. 하지만 성능에 가장 큰 영향을 미치는 요소가 학습 모델보다 휴리스틱에서 비롯되고 있다는 단점도 식별하였다. 이에 본 논문에서는 이러한 아키텍처의 구조와 사용한 기술들과 알고리즘에 대해 자세히 기술하였으며 접근 방향을 제시한다.

The infrastructure that man absolutely needs creates a lot of environmental load. The environmental load is quantified global environment pollution. So we can use LCA method for assess and control environmental load. In this study, we developed the environmental load estimating model to evaluate quickly in design stage when maintaining infrastructures facilities. Especially, we chose NATM tunnel because it is economical and there are many example of construction on public roads and expressway. First, we made a list of the breakdown cost by using collected unit cost of Korea Expressway Corporation and Seoul-Si about tunnel maintenance. So we chose major work classification. We selected the major classification such as pavement repairing inside tunnel, leaked surface treatment of tunnel, attached tile repairing inside tunnel and tunnel cleaning etc. We excluded concrete repairing because it is not easy to define maintenance factor about concrete repairing. Next, we made data bases of standard supply and resources need by specialist work classification. Using data bases, we was able to estimate environmental load by designating an input variable such as lane, pavement, length, tile repairing, leaked surface treatment and cleaning method. Lastly, we made environmental load estimating model after it is verified by comparing the results with the actual environmental load and estimated environmental load. Finally, our goal of this study is to develop the methodology that easily estimates the environmental load. Accordingly, the environmental load will be decreased by using this model in stage of planning, design and maintenance. Also, it is expected that the maintenance management estimating model developed from this study will be possible to do eco-friendly management of the road and tunnel construction.

The effect of the ionization energy on the common house mosquito, Culex pipiens, pupa was investigated as the hatching rate, longevity and detoxification enzyme activity. The longevity of adult emerging in the pupa decreased depending on the exposure dose of Gray (Gy) in Cx. pipiens. The hatching rate of the F1 generation egg derived from Cx. pipiens pupa treated up to 70 Gy did not show any difference with the control, but the eggs did not hatch 100% at 120 Gy exposure. These results showed that Cx. pipiens was sterilized at 120 Gy. Several detoxifying enzyme (GST, non-specific esterase and MFO) activity of Cx. pipiens adult emerged from pupa irradiated with 120 Gy was investigated. The difference in activity was observed in female than in male irradiated with electron beam. As a result, electron beam irradiation seems to affect enzyme activity as well as induce infertility of Cx. pipiens.

The tobacco cutworm, Spodoptera litura(Fabricius) is serious pest that hurts tomato crops, actives long time of the year. Without pesticide applications, sex pheromone delta traps through experiment first and second half setting during cultural seasons in glasshouse and greenhouse. We investigated captured number of S. litura both in and out side of the two type of tomato cultivated greenhouse. As a result of investigation, captured number of S. litura showed the wave and three high peak typed graph throughout 10 months experiment. First time expression of S. litura was late April in outside installed traps and after that occurrence rate increased gradually until late August. In september, the rate decreased remarkably to middle November in both in and out side treated traps. The result also expressed that captured average number of S. litura in inside of the greenhouse were 8~10 units, and were 15~20units in outside treated traps. Simultaneous installation of internal and external sex pheromone traps succeeded in eliminating a considerable number of S. litura male moths, and the number of larvae was expected to be considerably reduced. Consequently in the experiment, captured male number of S. litura were about 220 units in outside, on the other about 80 of S. litura captured in inside installed traps.

The purpose of this study was to investigate the effects of core muscle training on balance ability. Forty subjects in their 20s participated in a 6 week core muscle training program. Balance ability before and after the intervention were assessed and analyzed using the Romberg test, which was conducted on the floor, pedalo, and balancefit. The differences between the measurement methods of balance ability using varied platforms was also compared and analyzed. After the 6-week core exercise training program, the training group represented statistically significant increases in all 3 methods for static balance ability. In the control group, all 3 methods represented no statistically significant increases. Upon comparing the different methods of the Romberg test, there were no notable differences between conducting the test on varying platforms for both groups. This study suggests that the core muscle exercise training program increased the balance ability.

The purpose of this study was to compare the effects of respiratory exercise on cardiopulmonary function and muscle activity of rectus abdominis in smokers and non-smokers with elderly people. All the participants were older than 65 years, and twenty non-smokers, and twenty smokers participated. Non-smokers and smokers were randomly divined into 10 feedback breathing exercises (FBE) and a balloonblowing exercise (BBE) group. The FBE and the BBE were performed three times a week for four weeks. Forced vital capacity (FVC), forced expiratory volume at one second (FEV1), forced expiratory volume at one second/forced vital capacity (FEV1/FVC), peak expiratory flow (PEF), and vital capacity (VC) were measured as pulmonary function. EMG was used to measure the activity of the rectus abdominis. In the FBE and BBE groups, FEV1 was significantly lower in non-smokers compared to smokers at two and four weeks (p<.05), FEV1/FVC, PEF and VC were significantly lower in non-smokers compared to smokers to pre-test, two weeks, four weeks and six weeks (p<.05). Muscle activity of rectus abdominis was significantly difference in the BBE group at pre-test, two weeks, four weeks, and six weeks (p<.05). These results suggest that respiratory exercise was effective in improving pulmonary function and rectus muscle activity.

This study used both kinesiotaping and extracorporeal shock wave therapy on patients diagnosed with frozen shoulder - a common musculoskeletal disorder in adults - in order to observe the effects on the joint range of motion. 21 adult(male 12, female 9) were selected and distributed into randomized groups. One group received kinesiotaping (n=10) and the other group received kinesiotaping together with extracorporeal shockwave therapy (n=11). After a 6 week duration of receiving kinesiotaping and extracorporeal shockwave therapy, changes in the joint range of motion in the patients were observed. Post-treatment of frozen shoulder, the changes in abduction within the shoulder joint were as follows: in both groups there was a noticeable increase in the joint range of motion (p<.05). Post-treatment of frozen shoulder, the changes in external rotation within the shoulder joint were as follows: both groups showed a significant increase in the joint range of motion (p<.05). The result of suggest that, it can be inferred that both the extracorporeal shockwave therapy and kinesiotaping are effective in increasing the joint range of motion in patients with frozen shoulder.

Nanoemulsions are actively used in several applications for pharmaceutical, cosmetic and chemical industries. In this study, we propose the use of microfluidizer known as high pressure homogenizer to prepare lipid nanoemulsion as a potent cosmetic delivery carrier. The lipid nanoemulsions were prepared by O/W emulsion with hydrogenated lecithin and different type of oils. Effects of oil type on the stability of the lipid nanoemulsion were investigated with Dynamic Light Scattering (DLS) and Zeta-potential. Arbutin was used as model drug for transdermal administration through hairless mouse skin. Transdermal arbutin delivery using the lipid nanoemulsions was studied with HPLC method.

The purpose of this study was to determine the effects of music therapy and ball exercise on women experiencing menstrual discomforts, thereby identifying the validity of these methods as interventions against menstrual discomforts, with a particular goal of presenting basic data for clinical use. Twenty university students in their 20s were assigned to two therapy groups in a sequence via simple random sampling; ten subjects attended a ball exercise combined with music therapy group and the other ten subjects attended a music therapy group. Ball exercises were conducted 3 times per week for a total of 12 times, starting from 3 weeks before the expected first day of the menstrual period and ending on the last day of the menstrual period. Similarly, the subjects participated in music therapy by listening to music for 35 minutes per session and 3 sessions per week, starting from 3 weeks before the expected first day of the menstrual period and ending on the last day of the menstrual period. Five out of six categories of menstrual discomforts were significantly decreased in both music therapy and ball exercise, the exception being changes in the autonomic nervous system, while those in the music therapy group showed a significant difference only in the category of behavioral changes. The results of the present study demonstrate that the ball exercise combined with music therapy more effective in improving menstrual discomforts than the music therapy group.

Riptortus pedestris is a major agricultural pest in Korea. To manage this pest, it is necessary to understand the complete life history of R. pedestris. However, most studies have focused on the summer period when the pest attacks crops. Therefore, we conducted laboratory and field experiment to identify overwintering behavior of adult R. pedestris. First, we conducted two laboratory experiments to examine overwintering habitat preferences and spatial distribution of R. pedestris in the habitat. Second, we conducted field survey to characterize overwintering sites of R. pedestris in diverse landscapes. In the laboratory conditions, R. pedestris almost exclusively showed overwintering behavior in the leaf litter arena (63%) among the structures tested (rocks: 3%; rotten wood: 0%). And spatial distribution of R. pedestris showed solitary behavior in leaf litters. In the field, we located 12 individuals of overwintering adults from the urban areas, whereas no individuals were found from the high-elevation mountains and agricultural landscapes. Our results suggest that R. pedestris mainly use leaf litter as an overwintering structure, with solitary behavior, and low-elevation forested areas near urban landscapes seem to be more preferred overwintering sites.

The purpose of this study is to investigate effects of Maitland orthopedic manipulative physiotherapy and stretching on pain, cervical range of motion, and muscle tone of adults with forward neck posture. A total 40 subjects were divided into a Maitland OMPT group(n=20) and a stretching group(n=20), performing joint mobilization exercise and stretching three times per week for six weeks. As for changes in pain, statistically significant decrease were found before and after the exercise within group comparison( p<.01), while no statistically significant difference was observed between-group comparison. In changes in cervical range of motion before and after the exercise, the Maitland OMPT group showed statistically significant increase(p<.01) in flexion, (left lateral flexion(p<.05), extension, left rotation, right rotation, and right lateral flexion, while the stretching group showed statistically significant increase(p<.05) in extension(p<.01), left rotation, left lateral flexion, right rotation, and right lateral flexion. However, no significant differences in between group comparison in flexion, extension, right rotation, left rotation, right lateral flexion and left lateral flexion. The results of measuring muscle tone changes showed that the Maitland OMPT group and the stretching group did not show significance in within and between group comparison(p<.05). In conclusion, the Maitland OMPT and stretching were effective on improving pain and range of motion.

The purpose of this study compared the ability of feedback breathing training (FBT) and balloon blowing training to enhance the breathing of elderly people. The subjects were randomly and evenly divided into a feedback breathing training group (FBTG) and a balloon blowing training group (BBTG). Each group trained 3 times a week for 4 weeks, with the training suspended during the last 2 weeks. Pulmonary function measurements were obtained before the test and 2, 4 and 6 weeks after the test: forced vital capacity (FVC), forced expiratory volume at one second (FEV1), FEV1/FVC, peak expiratory flow (PEF) and vital capacity (VC). A repeatedmeasures ANOVA was conducted for the significance test. The FBT resulted in a significant increase in the FVC, FEV1/FVC, PEF, and VC of the elderly smokers after 4 weeks and a significant decrease in the FVC, FEV1/FVC, and PEF after 6 weeks. The BBT resulted in a significant increase in the FVC, FEV1, FEV1/FVC, PEF, and VC of the elderly smokers after 4 weeks and a significant decrease in the FVC, FEV1/FVC, and PEF after 6 weeks. In conclusion, An at home breathing rehabilitation program, in addition to balloon blowing, could increase the breathing performance of elderly people.

The goal of this study was to assess the effect of a group exercise program on cognitive function of elderly people. Subjects were chosen to be elders with dementia having minor to moderate degrees of cognitive function. Study was started out by randomly dividing the 16 subjects into two groups, each with 8 people; the group exercise group and the control group. The group exercise group performed 8 weeks of group exercise program and general physiotherapy while the control group only performed general physiotherapy. Cognitive function was measured by Korean version mini-mental state examination. The study group's attention and calculation statistically significantly improved but the control group saw no statistically significant change. The group exercise program affected improvement in cognitive function of elderly people with dementia and in particular, was effective for enhancing their attention and calculation.

The objective of this study was to examine the effects of auditory biofeedback training and kicking training on walking times in patients with hemiplegia to determine if the effects of such training would be maintained even after stopping the intervention. Thirty hemiplegia patients were selected and randomly assigned to a control group of 10 patients to receive general exercise treatment; an auditory biofeedback training group of 10 patients to receive auditory biofeedback training, along with general exercise; and a kicking training group to receive kicking training, along with general exercise. All the patients received their respective training 12 times in total, three times per week for four weeks. In addition, all those in the control and experimental groups received the same general exercise treatment 12 times in total, three times per week for four weeks, and underwent follow-up tests thereafter. The patients’10m walking times were measured using a stopwatch. The significance was analyzed using repeated-ANOVAs. In cases where there were interactions between measuring times and groups, in each group were examined using repeated-ANOVAs. In cases where there were differences, post-hoc tests were conducted using repeated of contrast test. The 10m walking times of the control and experimental groups were significant differences in 10m walking times were shown between measurement times(p<.05), and significant differences in the interactions between measuring times and groups were shown between the groups(p <.05). However, no significant differences in 10m walking times were shown between the groups(p>.05). The auditory biofeedback training group showed significant decreases in walking times four weeks after the beginning of the intervention(p<.05) and significant increases eight weeks after the beginning of the intervention(p<.05). The kicking training group showed significant decreases in walking time four weeks after the beginning of the intervention(p<.05) and maintained the walking times without showing any significant differences eight weeks after the beginning of the intervention(p>.05). The walking speeds of only the kicking training group were maintained until eight weeks after the beginning of the intervention.

The objective of this study was to examine the effects of auditory biofeedback training and kicking training on walking times in patients with hemiplegia to determine if the effects of such training would be maintained even after stopping the intervention. Thirty hemiplegia patients were selected and randomly assigned to a control group of 10 patients to receive general exercise treatment; an auditory biofeedback training group of 10 patients to receive auditory biofeedback training, along with general exercise; and a kicking training group to receive kicking training, along with general exercise. All the patients received their respective training 12 times in total, three times per week for four weeks. In addition, all those in the control and experimental groups received the same general exercise treatment 12 times in total, three times per week for four weeks, and underwent follow-up tests thereafter. The patients’10m walking times were measured using a stopwatch. The significance was analyzed using repeated-ANOVAs. In cases where there were interactions between measuring times and groups, in each group were examined using repeated-ANOVAs. In cases where there were differences, post-hoc tests were conducted using repeated of contrast test. The 10m walking times of the control and experimental groups were significant differences in 10m walking times were shown between measurement times(p<.05), and significant differences in the interactions between measuring times and groups were shown between the groups(p <.05). However, no significant differences in 10m walking times were shown between the groups(p>.05). The auditory biofeedback training group showed significant decreases in walking times four weeks after the beginning of the intervention(p<.05) and significant increases eight weeks after the beginning of the intervention(p<.05). The kicking training group showed significant decreases in walking time four weeks after the beginning of the intervention(p<.05) and maintained the walking times without showing any significant differences eight weeks after the beginning of the intervention(p>.05). The walking speeds of only the kicking training group were maintained until eight weeks after the beginning of the intervention.

The purpose of this study is to provide the case of influence of myofacial release(MFR) and cryotherapy in acute whiplash injury. The subjects were consisted of 3 adults(2 males, 1 female) who had been diagnosed with whiplash injury. The performance period was 1 weeks, 6 times and 1 time is 40min(MFR: 20min, cryotherapy: 20min). We measured neck pain(Visual analogue scale, VAS) and cervical alignment(cervical curvature & line of gravity). All measurements of each subject were measured at pre-treatment and post-treatment. The results are listed below. The neck pain(VAS) index decreased from 7.54cm to 4.11cm. The cervical curvature increased from 23.62°to 29.76°. The line of gravity decreased from 8.03mm to 3.66mm. Based on the results, it can be suggested that both MFR and cryotherapy can be used to neck pain and alignment in acute whiplash injury.

The fact that flip-flops, one of many different types of unstable shoes, are light and relatively easy to put on, accounts for their popularity among people. But because flip-flops rely heavily on the support of a single thong between your first and second toes, they impose a huge amount of pressure onto lower leg. Thus in the following experiment we tried to examine the different effects of flip-flops and running shoes in terms of their effect on muscle activity and fatigue of tibialis anterior and gastrocnemius during walking. In order to measure an electromyogram we used Free EMG system. 10 men and 10 women in running shoes ran on treadmills for 15 minutes at 4.8km/h, 2 days later the same experiment was carried out, but this time, in flip-flops. p value turned out to be greater than .05 and thus there was no considerable difference between the effects of flip-flops and running shoes on muscle activity and fatigue during walking. Therefore we conclude that despite the fact that flip-flops are considered unstable, their effects on muscle activity and fatigue of tibialis anterior and gastrocnemius are negligible.

Monochamus saltuarius, which mediates Bursaphelenchus xylophilus is one of the important vector of pine wilt disease recently. M. saltuarius showed difference with weight, growth, and oviposition according to species of trees. The most feeding amount and feeding area were determined in P. koraiensis. However, M. saltuarius almost did not feed and longevity was observed very short time only for 10 day in Sciadopitys verticillata. Weight, length and head width were measured the highest growth of M. saltuarius in P. koraiensis. Female of M. saltuarius was determined more growing than male of M. saltuarius in all species of trees. Tree preference for oviposition of M. saltuarius was the highest choice in P. densiflora. However, lots of scar for oviposition have observed but M. saltuarius laid less eggs in P. rigida. This result is related to bark thickness of trees. Ovipositional frequency has been consistently maintained to P. densiflora and P. koraiensis at 20 day intervals. In this study, physiological and ecological characteristic of M. saltuarius to preference of trees were researched could be helpful for managing of M. saltuarius.