Kibocode | Real Time Data Collection Application For Ecommerce Platforms

Developed Multichannel E-commerce Data
Management System

Project Overview

Intellicoworks, a DevOps, SecOps & DataOps service provider partnered with KiboCode/ProfitSpy to develop a platform that manages pricing information, stock availability, order management, asset management, and more. KiboCode/ProfitSpy is a seller’s engagement dashboard for data collection from different e-commerce platforms such as Shopify, eBay, Walmart, and Cartzy.

Project Requirements

The client required a platform that would keep track of;

The platform also needed to aggregate profitable platforms and recommend where to sell or buy more.

Project Challenges

The biggest challenge was to maintain the uptime SLA (99%) with scrape jobs. To resolve this, a dashboard of jobs and routines running within a defined time was created.
An operational communication dashboard was also set up for administrators to monitor and review operations.
A quarterly and daily board was set up for administrators to view the progress of application scrape jobs.
Finally, a data operation dashboard was created for reviewing the growing data needs with archive or purge information that wasn’t required.

Project Solution

The team developed all development, cron, security, deployment/rollback and data governance operations.
The team made solutions for uptime requirements, SLA management for communication services, and data visibility.
Also, customized analytics were created to identify delay concerns and resolve them through hardware and software optimization techniques.
As part of the data operations, the entire data set needed to be refreshed across all platforms with over 15 million products needing to be updated regularly. To address this, the team developed producer/consumer cron jobs to update pricing structures, pictures, and variations for all products. Additionally, an aggregated summary report is available for all platforms.

Project Results

Intellicoworks was able to help KiboCode/ProfitSpy expand its business from one business unit to multiple units with branding options. Kibocode/ProfitSpy was able to create 5+ brands based on this using approximately the same infrastructure handling different tenants. The project has been working fine for the past 3 years, and customers are still giving in requirements for modification.

Technology Stack

"Working with Intellicoworks has been a game-changer as their expertise in DataOps and DevOps allowed us to provide accurate data aggregation and analysis within seconds. Thanks to Intellicoworks, our project has been running smoothly, with efficient real-time monitoring that ensures we deliver accurate data to our customers."

Harry ArbasaDirector of Projects, BlackBird

Intellicoworks' team of experts impressed us with their in-depth knowledge of data management and analytics. They delivered a highly scalable and efficient solution for our social media marketing platform, demonstrating their professionalism and expertise.

Steven ClaytonCEO, Netblaze

"Intellicoworks has been a great partner in developing solutions for our growing gaming platform. Their approach was scalable and sustainable, and their solutions brought benefits in trust, transparency, traceability, efficiency, speed, ownership, and enhanced security.

Jamie ThompsonFounder, VulcanForged