A gaming data-driven organisation needed a reliable and scalable ETL solution to ingest, transform, and load large volumes of customer and transaction data into Amazon Redshift. By implementing AWS Glue jobs integrated with Redshift, the company automated data pipelines, reduced operational overhead, and enabled faster business insights at scale.

The Challenge

The data company faced several challenges with its existing ETL processes:

• Manual data transformation scripts led to inconsistent data quality.
• High operational overhead in maintaining on-premises ETL jobs.
• Difficulty scaling pipelines as data volumes grew.
• Limited visibility into job performance and error handling.
• Slow data availability in Redshift impacted downstream reporting and analytics.

Our Solution

AWS Glue was selected to modernise the ETL framework.

• AWS Glue Jobs to process raw data from Amazon S3 and transactional sources, applying business rules and cleaning before loading.
• Glue Crawlers to automate schema discovery and catalogue metadata in the AWS Glue Data Catalog.
• Integration with Amazon Redshift using Glue’s native connectors to efficiently load transformed datasets.
• Job Monitoring & Orchestration with AWS Glue Studio and Amazon CloudWatch for visibility and alerts.
• Scalability & Serverless Architecture ensured data pipelines scaled automatically with data volume without infrastructure management.

The Result

Automation: Reduced manual ETL maintenance by 70%, freeing up engineering resources.

• Faster Insights: Data availability in Redshift improved from hours to near real-time (sub-15 minutes).
• Data Quality: Implemented data validation rules in Glue, leading to a 95% reduction in downstream data errors.
• Cost Optimisation: ETL costs decreased by 40% through Glue’s serverless pay-per-use model compared to legacy on-premises ETL.
• Scalability: Seamlessly handled peak data loads during month-end processing with no downtime.

The post Gaming Data Modernises ETL Pipelines with AWS Glue and Amazon Redshift for Scalable Analytics appeared first on Rambunct Consulting.

Evil Hat Productions partnered with Rambunct to migrate from legacy third-party hosting to an AWS Graviton-powered infrastructure with a complete Drupal 9 upgrade, improving website performance, scalability, and e-commerce capabilities for their award-winning tabletop RPG community.

The Challenge

• Drupal 7 nearing end-of-life posed security and feature limitations for community engagement.
• Legacy hosting hindered performance during game launches and traffic spikes.
• Poor mobile optimisation and plugin support hurt user experience and content delivery.
• High hosting costs and vendor lock-in limited technical flexibility and growth.

Our Solution

• Deployed Graviton2/3-based Amazon EC2 instances with auto-scaling for high-performance, cost-efficient hosting.
• Upgraded Drupal from version 7 to 9 with responsive design and streamlined content workflows.
• Migrated e-commerce, community, and download systems into a flexible, scalable Drupal framework.
• Implemented PHP 8.x, MySQL 8, and modern AWS security tools for performance and compliance.

The Result

The migration resulted in significant gains in performance, cost efficiency, user experience, and platform scalability.

• 60% improvement in site performance and page load times using Graviton-optimised instances.
• 40% hosting cost reduction through efficient use of EC2 resources and modern infrastructure.
• 99.9% uptime ensured seamless access during game releases and peak traffic periods.
• 85% boost in mobile usability, improving access for gamers on tablets and smartphones.

The post Rambunct Modernises Evil Hat’s Gaming Platform with AWS Graviton & Drupal 9 Upgrade appeared first on Rambunct Consulting.