Even with the best planning system components still fail, network lines can go down, and systems can still crash. Although I had developed considerable fail safe plans, processes and procedures there were still occasional system outages. With redundancy and good processes in place these outages rarely if ever affected our customers ability to place an order. When ever there was a system outage and while fail safe processes were in place it was my responsibility to coordinate and review the failed systems fro a root cause analysis report.