Finding efficient transport as data scales massively

first_imgData is being procured at an ever increasing rate for analytics, machine learning, and other types of analysis. But Tbytes (or even Zbytes) of data need a transportation system to be useful and although we’ve transitioned from moving data through individual pipes to cloud-based services, we face extended requirements in practice. IoT devices are becoming more prevalent and we need to consider how we will transmit the exponential amount of data before we are suddenly confronted with the need.Applications such as real-time big data analysis require high bandwidth access to all that data. Standard hardware solutions can prove to be inadequate due to bandwidth and capacity. So, to solve for cost (especially when scaling up), bandwidth, capacity, and long-term reliability, there are two valid options at present. The first is cloud computing over high speed Internet and the second is localized portable storage arrays with high speed fiber connections.Cloud SolutionsThe advantages of cloud solutions include offloading cost and hassle of growth onto a cloud provider. Local machines can be offloaded to a generally reliable cloud system. Enterprise level storage arrays with redundancy and historical backups are commonly available from many cloud providers who offer additional reliability and performance from networks that deploy multiple decentralized data centers. With the growing ecosystem of global datacenters maintaining massive virtual clouds, cloud solutions provide an increasingly robust and convenient way in which to store and transfer large volumes of data generated from new technologies and applications such as IoT, autonomous vehicles and other connected smart devices.But while a standard Internet connection provides easy access, it also limits bandwidth to Internet connection speeds. And while giving up the hassle of maintaining the system, you also give up control over the performance of cloud machines, being limited to what is provided.Localized Portable SolutionsWith localized portable solutions, performance can be customized to meet application needs, giving great flexibility. Compute load can still be offloaded, this time from a client machine onto the server, and you can set up security protocols so that only local clients can access the system. The main advantage of localized systems is that connection speeds are much higher using high speed fiber network adapters. 10Gb/s connections over Ethernet have begun to break into the consumer level market and even greater speeds are available over commercial grade SFP connections and optic fiber interconnects. Compared to the national average of 96Mbps/32Mbps up/down over the Internet, this offers notably faster speeds. With IoT expected to generate Zettabytes of data annually alongside the growth and development of new technologies such as machine learning that take advantage of these massive datasets, this speed may not be enough for certain applications. In addition to the added total bandwidth, localized solutions also offer much lower latency and can benefit applications that need low response times, such as video editing of high resolution footage and compositing/rendering Hollywood-grade special effects sequences. For added speed and responsiveness, localized storage systems can be customized with solid-state storage drives as high speed data buffers or used in place of traditional hard drive storage media as the primary storage units.With localized units, transfer and deployment of entire storage systems can be as easy as carrying it to the needed location and hooking it up, as with CP Technologies’ Portable Storage Arrays. These types of storage devices offer a convenient and efficient means of migrating hundreds of TBs of data to a cloud provider. Data can be transferred and stored on the system in a minimal amount of time using high speed fiber connections, then hand carried or shipped to the cloud provider’s datacenter. With such localized solutions, you can transfer TBs of data significantly faster by redeploying in the new location compared to sending all the data over the Internet. And, if you need Internet accessibility, localized solutions can be configured to be Internet accessible. Additionally, by having a discrete portable storage unit, you also maintain a high degree of data security when transferring data from site-to-site, as you can have personnel monitor the unit at all times with significantly reduced for concern over Internet hacking or unauthorized access, since it’d take a physical connection and power to the storage unit in order to access the data while in transit.The main disadvantage of localized storage is that it is not as robust as decentralized cloud storage. If a flood or some other act of God happens and you don’t have additional off-site machines, then you can lose everything. And capacity and growth will be limited by the size and number of local machines. While localized solutions tend to be very cost effective, additional costs for space, power and cooling need to be taken into account when expanding upon an existing storage solution.Whichever solution is the best fit for you, something to think about is creating redundancy of data. Decentralized clouds can mitigate the effects of disasters by spreading out their data across multiple data centers. Local systems should be used with an accompanying off-site storage solution to ensure that the security of the data system is decoupled from its geographic location. When transferring machines from site-to-site, having a ruggedized design like those made by CP Tech ensures that data remains safe when in transit.Michael McCormack is a CEO of Combat Proven Technologies and has extensive domestic and international experience in managing organizations that design and manufacture a wide range of innovative products. His experience covers over 25 years in defense and industrial markets and previous to that served in the US Air Force. Share this:TwitterFacebookLinkedInMoreRedditTumblrPinterestWhatsAppSkypePocketTelegram Tags: IoT Continue Reading Previous Benchmark scores highlight broad range of machine-learning inference performanceNext How system level noise in digital interfaces can lead to spurious errors in serial Flash memorylast_img read more

We were feeling like the hunted Wounded officer recalls Moncton rampage

first_imgMONCTON, N.B. – A Mountie who was wounded during a shooting rampage in Moncton, N.B., said he has “absolutely no doubt” that he could have downed Justin Bourque had he been armed with a carbine rather than his pistol.Testifying at the RCMP’s Labour Code trial Monday, Const. Eric Dubois recalled crouching behind his cruiser, wounded and bleeding, as Bourque opened fired on officers on June 4, 2014.He said he watched Bourque for roughly four seconds as the gunman casually walked across a road, “like someone who was crossing the street with a dog in his hand.”Dubois told Moncton provincial court he had started his shift at 7 p.m. and, about half hour later, heard reports of an armed man wearing camouflage walking down the road.He responded to the scene armed only with his 9mm pistol. But when Bourque crossed his line of vision, he was out of the pistol’s range, he said.Police use of the C8 carbine became a central focus after the Moncton shootings. The Mounties in that city did not have access to carbines at the time and some critics complained police were outgunned.When asked by prosecutor Paul Adams if having carbines would have made a difference that evening, Dubois said: “There is absolutely no doubt in my mind.”“He would have gone down,” said Dubois, based on training he received on carbines after the shooting.“Everything would have been different. As soon as he started firing at us, we were feeling like the hunted. … We knew we didn’t have the firepower to respond.”Dubois said he had rushed to the scene to assist Const. Martine Benoit, whose police cruiser was under fire, when he was hit while crouched behind his vehicle. He saw blood coming from holes in his pants and shirt.At one point he broke down in tears, telling the court he went against his training — which taught him to keep himself safe — and instead decided to put his own life at risk to try to help a fellow officer.“When I chose to join the RCMP, I was not a teenager, I was an adult, so it was my decision to accept the risk,” said Dubois, who joined the force in 2010 after working more than two decades at a paper company.“If I have to die, I will die.”Dubois required surgery after being hit on his left bicep, his lower left leg and upper right leg.The national police force is accused of violating the Labour Code for allegedly failing to provide members and supervisors with the appropriate information, instruction, equipment and training in an active-shooter event.Dubois said upon joining the force, he was trained to use his pistol and a 12-gauge shotgun, and had asked to be trained on a rifle.“They refused to provide the training,” he said, adding that he has been hunting since he was young boy.Dubois also recalled seeing an officer dragging a lifeless Const. Fabrice Gevaudan, and rushing over to assist.“When I looked at Fabrice, to me, he had the face of a dead person,” he said, adding he used to work in a morgue and is also trained in first aid.“There was nothing I could do.”Gevaudan and constables Doug Larche and Dave Ross were killed, while Dubois and Const. Darlene Goguen were wounded when Bourque used a semi-automatic rifle to target police officers in Moncton’s northwest end.Later Monday, Mountie Simon Grenier testified that he had taken the day off on June 4, 2014.Choking back tears, Grenier said he was outside of his home enjoying the nice weather when his neighbour ran over to say something had happened.Grenier, a former member of the Canadian Forces who now works on Prime Minister Justin Trudeau’s security detail, said he “kissed the kids” and rushed into the station to put on his gear and grab a weapon and vehicle.Grenier said he wanted a C8 carbine, but was told none were available, so he took a 308 rifle. He explained that he wanted a carbine because they are more accurate and easier to handle than a rifle.He and another officer headed to the scene, and at one point they saw the police cruiser of Ross — someone Grenier described as a friend.“There was a pool of blood right by the driver door,” said Grenier, bowing his head on the witness stand.He recalled going to the trunk of his cruiser and putting on body armour. He then heard of a sighting of Bourque over the radio and headed in that direction, but he never saw him.Both officers who testified Monday said they did not receive direction during the incident on where and how to respond. Both said they made their own decisions and judgements during the initial response.Bourque, who was targeting police in an effort to start an anti-government rebellion, was sentenced to life in prison with no parole eligibility for 75 years after pleading guilty to three counts of first-degree murder and two counts of attempted murder.The trial has heard from witnesses who testified they lacked the proper weapons or training to deal with an active-shooter threat.It continues Tuesday with testimony from an RCMP expert in use of force and officer safety training.Follow (at)AlyThomson on Twitter.last_img read more