Automated Power Pole Photography via Helicopters

change tycoon Pole Photography via HelicoptersFugro Roames aims to automate the process of acquiring high resolution pictures, to ablaze(p)uce the happen and cost associated with helicopter found pole merry-go-round command. The sound switchion leave alone contract on acquiring antecedently toyed algorithmic programs, as well as the introduction of model predictive control, to automate the over tout ensemble process, season in any case stand foring a workplaceing paradigm to simulate the operation of the think product.The comeing proposal leave aim to describe the intended topic and backcloth, season as well examineing soil information on celestial asset circumspection and sovereign aerial scudy connect to the ascertain. The report result also sidle up exclusively achievable milestones, and their respective toils, within the project plan as well as present a detailed OHS stake assessment of the projects practical and non-practical work.The work pe rpetrated during the semester, will hope to pull up s scoop ups sufficient groundwork for automated aerial asset management procedures, within the galvanisingal statistical distribution industry. correct and effective asset condition management is important to condition the longevity of an electric distribution network, while maximising its performance and operational qualification.1 At present, an efficient and cost effective method to test the one of a network, requires the wont of a human-piloted helicopter and a photographer to entrance high resolution images of violence poles and their subcomponents 2. Fugro-Roames, a telephoner which authenticly provides this to its customers, aims to reduce the pretend and cost associated with helicopter base pole top follow-up, by replacing the photographer with an automated camera gimbal to capture high resolution pictures of the network.Figure 1.1 Power Pole Photography 1Automated aerial asset management in the context of th is proposal refers to the habit of aerial platforms, to asses specific assets in an easy and cost-efficient manner, without the need of manual involvement. Unfortunately, and as it will be discussed in Chapter 3, the project topic is a form of technology that has not been widely researched however, various methods of aerial asset management, such as helicopters, UAVs or drones, do exist and atomic number 18 watercoursely in exercising within the industry.2.1 meet OutlineIt is the purpose of this project to develop a recession panorama contriver (RHP) in order to automate origin pole photography using camera gimbal system. The RHP will based on the algorithms created by Dr. Michael Kearney, which provide a solution to the photograph feasibility, photograph scheduling, and gimbal trajectory planning problems 3. For validation, the develop planner will be tested using simulation flight data provided by Fugro-Roames. gain examination will include the implementation of the RHP into a gimbal prototype, where sensitivity analyses and assessment of the sign assumptions will be land upd to determine the projects limitations and outline recommendations for future work. A more defined project plan will be set forth in Chapter 4 below.2.2 Motivation for Automated Aerial Asset ManagementIn order to overcome the limitations associated with conventional asset management methods, a high resolution image capture system was developed and is now usance to aid in the inspection, assessment and maintenance of electric distribution networks 4. However, the boilersuit cost associated with this method, outweights its improved efficiency, as it involves specialized labour (photographers) and the use of helicopters to complete the required task 5. The motivation to introduce an automated aerial asset management system, requires for the reduction of endangerments and overall cost associated with the current model, as well as alter the quality and selection of photographs taken.2.3 determine Aim, Objectives Intended ScopeSince the project, and all information available, are sponsored and provided by FugroRoames, the aims and objectives have been defined by the companys desires for the finished product. Therefore, the aim and draw a bead ond purpose of the project is to reduce the cost and risk associated with helicopter based pole top inspection, with the use of a Receding sight planner (RHP) that automates the movement and control of a camera gimbal system. Along with the proposed project aim, multiple objectives moldiness also be met whilts finish the work required. These include improving the algorithms created by Dr. Kearney, obtaining accurate efficiency gains for the RHP, figure and frame of referenceing a working gimbal prototype to be use for interrogation, and providing sufficient ground work for literal on-site testing and implementation, with the use of a helicopter, of the RHP beyond the project. Similar to the projects aim and objectives, the intended scope has also been shaped by the companys desires for the final product. Therefore, the scope can be draw asReview of accentuate information and cerebrate workAdaptation of algorithms created by Dr. KearneyDevelopment of Receding Horizon Planner public figure and build of a gimbal prototypePlanner implementation and testingAnalysis of results sensibility compendiumAssesment of projects assumptions paygrade of project and suggestion for future workPossible gimbal rig implementation and on-site testing taking into accounting the scope described above, it seems logical to break the project into three specific sections planner maturement and testing, prototype design and testing, and constitutional result analysis. The development and testing of the Receding Horizon Planner involves the emolument of existing control algorithms, to implement and verify its overall efficiency, using available and provided data. The design and testing of the gimbal protot ype, which should match the actual gimbal rig, involves the use of the developed Receding Horizon Planner to validate and improve oldly obtained results. Finally, thorough result analysis requires the break brush up of the planner and obtained results, to find how assumptions, parameters and particular components were affetcted.Although automated aerial asset management is a form of technology that has not been widely researched, the following chapter will provide a complete review of background literature which would closely resemble the general subject matter. The review will be broken into two sections aerial asset management, and autonomous aerial photography and gimbal control. Previous work related to these topics will be presented, reiterated and reviewed, focusing on sources related to asset management within the electric supply distribution industry.3.1 Aerial Asset ManagementAerial asset management , within the electric power distribution industry, has been implemented to replace conventional asset management and inspection methods, and provide a extravagant and accurate way to determine any defects that could be present.Whitworth et al. 6, in a work sponsored by EA Tecnology, propose the use of a helicopter-mounted camera to capture and store opthalmic information, in order to enhance the inspection of overhead power lines. In order to reduce camera shake and partially automate the inspection process, the authors recommend the use of an acquisition system, which finds and locks the camera to the location of the powerline, followed by a recursive algorithm that tracks the powerline smoothly, scorn the translation of the helicopter.Similarly, Earp et al. 14 describe an aerial inspection technique, which was also developed by EA Technology, that uses high resoluion images to perform a detailed condition assessment on electrical towers within a distribution network. The authors break down the helicopter based condition assessment, which is conside red an improvement from the video inspection method in 6, to include intravenous feeding different partsPre-flight Planning Inspection requirements, photographic sequences, camera trajectories as well as current wind and weather conditions, natural and man-make ground feature, and the locations of the electrical towers, are all taken into account during the pre-flight planning.Helicopter Inspection and Picture Acquisition A high resolution digital camera is used to take a set number of images, per tower, to meet the inspection requirements. Satellite-based Global Positioning System (GPS) and pitiful map displays are used to geo course credit each photograph taken, back to the tower.Image Processing, Analysis and watch judgment Captured images are examined and disposed a Condition Rating (CR), typically on a scale of 1 to 4 (1 describing best condition, 4 describing worst condition). The uniformity of the assessment, determined by the individual DNOs requirements, is ensured by t his vituperative step and therefore requires for a detailed condition assessment criteria, application-specific workstations, and accurate in-house training programme for assessors.Condition Based Risk Management (CBRM) A process developed by EA Technology, it combines practical and theoretical noesis about a specific asset, along with maintenance experience, in order to define its current condition.pickings a different approach, N. Ellis 7 canvass the use of Unmanned Aerial Vehicles (UAVs) to inspect power transition lines. The author investigated the cost, risks and overall efficiency that comes with the use of UAVs, searching for low budget automation strategies to be designed and tested. Unfortunately, due to regime regulations and the high capital and operating cost of the UAV, lead the author to the conclusion that the technology is not possible at the current time.As outlined by or so of the sources presented, the introduction of aerial asset management techniques, has do a big improvement on the inspection, assessment and maintenance of an electrical distribution network. Whilst most models present techniques that far surpass conventional inspection methods, the cost that comes with the involvement of specialized labour and helicopters, leaves undersized room for errors and inconsistent results. However, although the implementation of an UAV was not possible due to the introduction of new risks, the automation techniques, presented in 7, can be applied to previously discussed aerial photography techniques, and mitigate/remove any soon involved risks.3.2 Autonomous Aerial Photography and Gimbal ControlAutonomous aerial photography and control, within the electric power distribution industry, is not a topic that has been widely researched or implemented. However, the use of a camera and aerial images to predict and control the movement of UAVs is something that is commonly discussed and will therefore, be the main focus for this section.E. Skjon g et al. 8 investigate the recent commercial availability of UAVs within Search and Rescue (SAR) and Search and Tracking (SAT) applications. The authors then focus on the development of a SAT system, which is able to steer the UAV and focus the gimbal attitude on regions and objects of engage respectively, with the use of Model Predictive Control (MPC). The overall process is made autonomous by allowing data processor vision to work presently with the UAV autopilot and MPC, so objects can be simultaneously detected and introduce in an efficient manner.Similarly, C.E. Lin and S. Yang 9 explore the use of UAVs to detect and track specific objects, with the help of aerial photography and camera gimbal control. The authors implement the use of an Inertial Measurement Unit (IMU), which consist of a gyroscope, accelerometer, and magnetometer, along with an bearing and Heading Reference System (AHRS), to determine and ensure that the angles of the camera gimbal are in the correct refe rence frame. Both 8 and 9 use Global Positioning System (GPS) to determine the location of both the UAV and the target, using this birth to implement a reliable autopilot flight control for target detection and photography.R.J. Rajesh and C.M. Ananda 10 move outside from controlling the camera gimbal, attached to a UAV, and focus on stabilizing its movement to ensure that lay down photograph and/or video footage is taken. The use of Proportional-Integral-Derivative (PID) dominance is recommended by the authors, to compensate for the vibrations and gust, as well as control the position of the camera by stabilizing the movement of the gimbal. Manually tuning the controllers parameters is not recommended, as the process is considered time consuming and tedious, instead, the authors recommend the use of Particle Swarm Optimization (PSO) as the best-loved algorithm to complete this task.Uncertainty and disturbances are mentioned, but not properly investigated in 9, 8 and 10. A. Ashok et al. 11 investigate the international disturbances that affect the UAVs, as well as the dynamic and parametric uncertainties that arise in the mathematical autonomous model when subjected to a number of operating conditions. The authors reiterate previous approaches taken to design a strong control system, including the use of a PID controller for linear 12 and linearized 13 models, as well as the use of a Linear Quadratic Gaussian (LQG) controller 14 in the presence of uncertainties, before the Uncertainty and apprehension Estimation (UDE) method is chosen to synthesize the required controller.The control of a camera gimbal, as outlined by most of the sources above, is necessary in order to ensure the accuracy of photographs or video that is captured by the UAV. Although the use of conventional control methods is described above, only 8 focuses on the use of MPC, which is closely related to the project, to ensure that the UAV is able to detect and track objects efficiently and simultaneously.A clear representation of the projects tasks, has been outlined as a comprehensive project plan from the first to the final mean solar day of employment at Fugro-Roames. A visual representation and description of the plan is used to illustrate the timeline of the project, including all achievable milestones, which are related to the aims, objectives and intended scope of the project, discussed in section 1.2.4.1 Visual Representation of Project PlanThe use of a circumscribed GANTT chart was implemented to showcase the proposed flow of the project, from the first to the last day of employment. The timeline is hence separated into 24 weeks that are broken into 5 days, in the same manner as the business week format, where the project milestones and their corresponding tasks are allocated a precise number of days in which work is scheduled to take place.Green solid bars represent the projects milestones, where red solid bars indicate their respective tasks. The win of the overall project is tracked by the fulfilment of every achievable milestone, which can only be completed by first complementary their respective sub tasks. Completed milestones are shown with a gloomful line through the green bar, and completed tasks are shown with a yellow line through the red bar.Weeks 1 to 12, as shown in Figure 4.1, represent the core work to be completed, as milestones 3-5 directly relate to the aims, objectives and intended scope of the project. Weeks 13 to 22, as shown in Figure 4.2, outline the analysis and completion of the final pieces of assessment, including the thesis report and demonstration, which require the content from previous milestones to be completed. Weeks 23 to 24, also shown in Figure 3.2, outline a possible Milestone that can be completed until the final day of employment at Fugro-Roames. This milestone does not affect the previous pieces of assessment however, it will provide the company with important information that could prove v ital to the future of the project.4.2 Milestone Task BreakdownMilestone 1 Project ScopeThe project scope is necessary to determine the projects main objectives, and will therefore consume the work to be completed throughout the semester. To ensure all expectations are met, and the appropriate time is given to all project milestones, an agreement mingled with academic and industry supervisors is necessary.TaskID geezerhood DescriptionProject evaluation1.15Evaluate the requirements of the project, including potential goals and outcomes. Collect all necessary information to present during the supervisor meeting.Supervisor meeting1.21Meet with the projects academic and industry supervisors to discuss the project scope, and agree on the due dates for all pieces of assessment.Scope confirmation agreement1.32Compile a detailed scope which highlights the projects objectives, as discussed during the supervisor meeting.ResourcesWorkspace with an available computerAvailability from both s upervisors to organize a meetingMilestone Hazards and RisksMilestone 1 is natural to the project. Any delay could be considered a minor, but possible risk, as it affects the progress of the overall project. If this let on becomes bigger, and the project scope cannot be defined, then it can be separate as a major risk and mitigation strategies should be taken immediately. gull communication between all parties involved, can reduce and remove the possibility of the identified risks from occurring.Milestone 2 Project proposal of marriageThe project proposal is the first piece of assessment, which must be completed as part of the responsibilities for completing the project placement. The report highlights the work from Milestone 1, as it expands on the agreed aims and objectives, outlines the background information related to the projects main topics, and presents a visual and a clear representation of the project plan. A detailed OHS risk assessment, which analyses the potential ris k involved with the projects practical work, and any potential equipment used, will also be include in the proposal.TaskIDDays DescriptionResearch of relevant material2.15 realise background information and prior art related to the projects main topic.Project outline and intended scope2.24Expand on the projects scope decided in Task 1, expanding on the projects aims and objectives.Background and related work2.33Summarize and expand on the material obtained from Task 2.1.Project plan summary2.43Provide a detailed project plan, with logically ordered tasks and their respective milestones.OHS risk assessment2.52Compile an OHS risk assessment, which highlights the projects practical work and equipment used.Drafting and submission2.55Assemble the proposals individual sections, review the written report and submit viaTurnitin.ResourcesCompletion of Milestone 1Confirmation of university assessment due datesOHS risk assessments, regarding the use and control of the gimbal rigMilestone Hazar ds and RisksThe project proposal relies mostly on individual and previously completed work, however, certain sections require resources which are not readily available. The most significant obstacles, which would require mitigation, are the confirmation of all university assessment due dates and the risk assessments completed for the gimbal rig, which might be used during the project.Clear and constant communication with the universitys course coordinator, as well as the personnel in charge of the gimbal rig, is essential to mitigate and prevent any issues that could affect the completion of the project proposal.Milestone 3 Receding Horizon PlannerMilestone 3 is the first milestone that uses the algorithms created by Dr. Kearney to develop an on-line planner that controls the photograph scheduling plan and the movement of the gimbal throughout the event horizon. The completed Receding Horizon Planner will involve the use of a low level controller, an upper level planner, and an even t monitor, to be used in Milestones 47.TaskIDDays DescriptionAlgorithm testing and improvement3.15 remediate the current photograph feasibility algorithm, and test its efficiency.Model predictive control research3.25Find related material to be used when designing the Receding Horizon Controller.Lower level controller design implementation3.35The gimbal and camera are robustly controlled by the photograph scheduling algorithm chosen by the upper level planner.Upper level planner design implementation3.45Implemented the improved algorithm from Task 3.1 to generate a plan that the system will follow over a prediction horizon.Event monitor design implementation3.54Connect the results from Tasks 3.3 and 3.4 so that the plan is implemented and changed after certain events occur.ResourcesProgramming and modelling software programAccess to the projects repository and previous workMilestone Hazards and RisksThe progress of Milestone 3 could be significantly affected, if access to the nec essary repositories and previous work is delayed. As previous algorithms are necessary to the development of the Receding Horizon Planner, the completion of the project would be significantly impacted.Clear communication with the right personnel can help mitigate this issue before it affect the timeline and progress of the project.Milestone 4 Planner Analysis and ImprovementRigorous testing of the developed Receding Horizon Planner is required to find the necessary efficiency gains, so the planner can be implemented on the projects physical equipment. Data obtained from Fugro Roames, as well as the analysis and reiteration of the testing completed, will be completed to improve the found controller gains.TaskIDDays DescriptionTest current and newscenarios4.14Implement the Receding Horizon Planner on several simulated scenarios, using data received from Fugro Roames.Reiteration of Receding Horizon Planner testing4.23Fix any errors found in Task 4.1 and repeat the tests.Determine accur ate efficiency gains4.33Determine the required controller gains which provide the most accurate results.ResourcesCompletion of Milestone 3Sufficient testing data provided by Fugro RoamesMilestone Hazards and RisksThe lack of testing data used to complete this milestone, is a minor risk that could affect the project. Requesting said data ahead of time, would ensure that it is ready for when testing of the Receding Horizon Planner begins, leaving the project timeline unaffected.Milestone 5 Gimbal PrototypeMilestone 5 marks a key point in the project, as the implementation of the Receding Horizon Planner on a working prototype is essential to the projects success. The design of the prototype will be based on the actual gimbal rig owned and created by FugroRoames, to facilitate the implementation of the planner for further testing, at the end of the project.TaskIDDays DescriptionEmbedded system design and build5.17Design, build and combine the mechanical, electrical, and software compon ents of the prototype.Implementation ofReceding Horizon Planner5.26Test the Receding Horizon Planner using the gimbal prototype.Sensitivity Analysis5.35Identify and vary the dominant parameters, testing and improving the Receding Horizon Planner where possible.ResourcesCompletion of Milestone 4Mechanical, electrical and software design softwareWorking space and necessary build equipmentDevelopment of testing scenariosMilestone Hazards and RisksMilestone 5 introduces the use of practical equipment to design, test and build each component of the gimbal prototype. The misuse of the practical equipment, and the lack of component testing, are immediate risks to the completion of the prototype. Following the risk assessment outlines on Chapter 4, as well as completing the required testing before the Receding Horizon Planner is implemented, can help mitigate the risks described and prevent possible delays.Milestone 6 Assessment of Projects AssumptionsAs previously shown by Dr. Kearney, on the initial report he completed for Fugr-Roames, the introduction of the Receding Horizon Planner required changes to the initial assumptions made when designing the projects photograph allocation and gimbal control algorithms.The change and/or the addition of assumptions, by analysing the projects deficient parameters is, therefore, also essential when validating the results obtained in Milestone5.TaskIDDays DescriptionIdentify missing parameters6.12Determine the projects missing parameters based on the assumptions made by Dr.Kearney on his report.Evaluate the effects of missing parameters6.23Assess how the model is affected by each missing parameter.Update the projects assumptions6.32 ensnare a list of updated assumptions based on the results from tasks 6.1 and 6.2, to be used on further work.ResourcesCompletion of the Sensitivity Analysis Task within Milestone 5Milestone Hazards and RisksThe risks to Milestone 6 are comparatively small, where the largest possible problem involve s the inability to identify the effects of the projects missing parameters. Keeping a record of all parameter changes/assumptions made during previous tests is the best solution to mitigate/prevent this issue.Milestone 7 Project Evaluation and Recommendation for Future WorkIdentifying the projects limitations is an important process, as it allows recommendations for future work to be made and included on the final thesis report.TaskIDDays DescriptionIdentify projects limitations7.13 make the projects limitations, based on the results from Task 6.Develop accurate recommendations7.23 Expand on previous work and results from Tasks 6.1 to 6.3, including 7.1, to develop accurate recommendations for future work.ResourcesDevelopment of the Receding Horizon PlannerSensitivity analysis of the gimbal prototypeCompletion of Milestone 6Milestone Hazards and RisksThe completion of Milestone 7 is only affected by the work done in previous milestones. If previous tasks are delayed, any future rec ommendations run the risk of not being completed.To prevent this from affecting the final stages of the project, the plan/timeline outlined should always be followed, noting wher