Increase your data processing capabilities with Dynamic Engines

The volume of data processing jobs coming in to your team is rarely consistent, as is the volume of data involved in each job. Between day-to-day automations, ad hoc requests and incoming Big Data from the likes of sensors and IoT, it’s easy for the volume of work that your teams need to do puts pressure on your existing resource. In worst case scenarios, these sporadic peaks in demand can overwhelm your infrastructure, causing your servers to lag and, if pushed to their limits, crash.

In order to keep up, your teams need more power behind their workflows. Traditionally, the solution has been to increase capacity by investing in additional Server Engine licences. However, these investments are wasted when quieter periods cause them to stand idle.

Dynamic Engines are alternate way of scaling your FME holding to meet peaks in demand. They have the same capabilities as standard FME Server Engines; but rather than purchasing a dedicated asset, you are purchasing processing time. This way, your team are able to avoid downtime of high demand services/workflows by providing additional capacity using Dynamic Engine credits.



Dynamic Engines in Action


Dynamic Engines were introduced in 2020 to increase processing capabilities when your team needs it. As you’re only paying for usage, you’re able to launch as many engines as you need to scale processing without the need for additional licences.

They can be used to support a wide range of projects:

Supporting Big Data integrations: In our last post, we spoke about the improvements Safe Software has made to improve the way that FME handles Big Data. Dynamic Engines further support these improvements by providing a cost-effective way to process variable data streams.

Managing spikes in demand: Our clients at the London Borough of Harrow are using Dynamic Engines to facilitate the processing of their PCN webforms. Utilising Dynamic Engines to handle the requests that come in makes sense in this scenario, as the daily volume is highly unpredictable. The same can be said for any FME Server Apps your team has created for your organisation.

Improving parallel processing: Rather than paying for multiple fixed engines to perform parallel processing tasks, Dynamic Engines allow you to deploy as many engines as you need to get the job done efficiently.

Expediting urgent requests: Sometimes your team needs to drop everything and get a job done, either due to a critical event or pressure from internal stakeholders. Dynamic Engines can kick in for these jobs without everything else being put on hold.

The scalable nature of Dynamic Engines is perfectly suited to on-prem hardware, cloud environments like AWS and Azure and container-based environments such as Kubernetes. This opens the door for dynamic IT infrastructure and smarter resource management.



Increase your capabilities without increasing investment


Creating a stable data processing environment that can deal with the ever-changing volume of jobs can be a challenge for even the most experienced data teams. But meeting increasing capacity doesn’t have to break the bank.

Dynamic Engines are a cost-effective way to scale your existing data processing capacity. Being able to flex with demand will allow your team to not only improve the way your existing workflows are handled, but open the door to solving new challenges

In short, Dynamic Engines gives your team the confidence that no matter how large the job, your FME holding can handle it.


Are you interested in taking your FME to the next level? You can download a trail of FME Server from the Safe Software website.


If you’ve already got FME Server, a member of our team can arrange a trial of Dynamic Engines. Speak to our Account Manager, Dean Greenway, on 0121 232 8050 for more details.