How to Use Skedler with Amazon’s Elastic Search Tools

As the majority of IT-savvy businesses synchronize with the cloud, capital infrastructure charges are becoming rapidly replaced with more lucrative options which optimize and scale company costs. Rather than IT planning for weeks on end, users are able to instantly discover thousands of servers within minutes for more rapid, effectual results. This starts with Amazon Elasticsearch Service: the cloud’s top trending tool for Elasticsearch-Logstash-Kibana applications.

Skedler

With Amazon Elasticsearch Service, you’re able to effortlessly scale log analytics, text searches and monitoring within a few minutes. It also allows you to exercise Elasticsearch’s APIs and real-time functionalities along with its scalability and security models by production workloads, including Kibana, Logstash, and AWS; enabling you to start to action your data insights effectively and quickly. Simply run the AWS Elasticsearch service, or run your own cluster using the AWS EC2.

Server or Cluster?

If you choose to run the server on AWS, there are a few clear advantages. Primarily, you won’t have to manually replace failed nodes, since you can add it to the cluster as you go. You can add and remove nodes through an API and manage access rights via IAM, which is far easier than setting up a reverse proxy, as well as receive daily insights into daily snapshots to S3, including CloudWatch monitoring for your Elasticsearch cluster.

On the other hand, if you choose to download and run, you’ll have more instance types and sizes available. In this case, you’d be able to use bigger i2 instances than AWS alone, allowing you to scale further and get more insights into logs and metrics. You’re also able to alter the index settings with more detail than just analysis and replicas, such as with delayed allocation, which often carries a lot of data per node. Additionally, you can modify more cluster-wide settings than in AWS alone, as well as gain access to all other APIs, which is particularly useful when debugging. And whilst Cloudwatch collects a reasonable amount of metrics, with EC2 you can utilize a more comprehensive Elasticsearch monitoring solution, with clusters of more than 20 nodes at a time.

Amazon Elasticsearch Service within Skedler

Regardless of which route you take, the ultimate challenge is learning how to add reporting for your ELK application within the Amazon Elasticsearch Service. In this instance, Skedler accounts for proven reporting solutions specifically with ELK applications, with many of our customers running ELK and Skedler together on AWS to account for both log and IOT analytics, as well as several other features. Skedler provides helpful deployment options to add reporting to your existing AWS ELK application, including Skedler as a service within EC2, or Skedler AWS Containers service; both of which support Amazon Simple Email Service (SES) for emailing reports reliably and economically.
Ready to try Amazon Elasticsearch Service with and through Skedler? Try it free.  After the free trial period, you can purchase Skedler license and instantly convert your evaluation environment into a production environment. 

Skedler Version 2.6 is Released!

We are pleased to announce the availability of Skedler Version 2.6. It includes new features and bug fixes. New features include:

  • Email reports using Amazon SES which are now supported as an email provider in Skedler.
  • Skedler v2.6 now supports the following new versions of Elastic stack on both Linux and Windows:
    1. Elasticsearch version 1.7 to 5.1.1
    2. Kibana version from 4.1.x to 5.1.1
    3. Shield/Security supported from 1.0 to 2.4.1
    4. Kibana Shield plugin supported up to 2.2.1

Try the latest version of Skedler!

Skedler Plugin for Kibana is Coming Soon

By popular demand, we are reintroducing the Skedler Plugin for Kibana. It will include features of Skedler 2.6 and will work with Kibana 5.1. The plugin will be available in Standard, Advanced and Premier Editions and will be a separately licensed module.

Interested in being the first to use the Skedler Plugin? Email us at [email protected] and we will get in touch with you as soon as it becomes available!

Tip of the Month

How can I migrate my Skedler license to another server when I have already deployed Skedler on another server? This is a common question from our customers and is easy to do. Check out this how-to article on migrating your Skedler licenses.

Ready to start saving time by creating, scheduling and distributing Kibana reports automatically? Try Skedler free for 15 days.

Kibana Reporting in Action: A Kane LPI Case Study

Every company carries valuable data, whether it’s relevant to a specific client’s private information, statistics, or finances. Alongside the fear that you might lose precious data or incur a security breach with faulty programs, data needs to be filed and exported accurately in order to meet certain deadlines and practical standards; which is why Kibana reporting has proven to be an imperative tool for loss prevention within any given company.

The Company

Kane LPI Solutions is a prime example of how Kibana reporting achieved higher marketability within the cognoscente program Skedler. A trusted provider of Third Party Administration services for more than 15 years, Kane LPI has issued over US$11 billion of offshore annuity and investment products for an extensive global client base. They needed a robust solution to help prevent financial and reputation losses as well as boost KPIs. As it stood, competition was fierce — there were many much larger players out there on the field.

The Challenge

The company’s practical processes specifically involved sending sensitive and accurate post-trading files on a timely basis. Kane LPI’s clients had strict operational requirements for control and compliance: if the time window for sending files was missed, financial loss was borne both for them and the company. Delays like this could incur strict penalties by settlement and clearing corporations such as The Depository Trust and Clearing Corporation (DTCC). With so much at stake, our challenge was to fundamentally satisfy operational concerns to prevent those losses, as well as improve pragmatic business flow.

Kibana Reporting: A Means of Automation

Kibana reporting allowed Kane LPI to send out daily scheduled reports to both clients and internal users from thousands of lines of log entries within multiple systems, serving as a key monitoring tool and satisfying auditing requirements in the process. As a result, Skedler became a critical go-to ELK stack tool for this company and its clients, allowing Kane LPI to send out reports to their clients and internal users, which the company couldn’t do before.

Developers were able to receive automated error reports at the beginning of the day, allowing them to ensure information is sent to regulatory and settlement organizations to meet deadlines. Simultaneously, managers received daily and weekly reports on SLA performance and non-compliance, enabling them to take remedial steps to prevent recurrence and to protect time-sensitive transactions. Vendors also received daily and weekly reports on SLA performance and non-compliance of their product in KPI solution, which fundamentally reused the investment of energy and time in an ELK stack based solution.

As a precautionary measure, Skedler introduced a critical line of defence to errors by inaugurating manager and software vendors with automated reporting sent at the beginning of the day, which described potential errors during transfer of files, allowing future errors to be minimized. We then added another layer of security by administering any issues during batch runs from the previous 24 hours. 

Statistically, all of these enhancements enabled Kane LPI’s clients to avoid up to $5 million per month in trade and exchange losses, as well as protect their well-nurtured reputation as a high-quality provider.

Ready to start saving time by creating, scheduling and distributing Kibana reports automatically? Try Skedler for free.

Copyright © 2024 Guidanz Inc
Translate »