How a Company in Los Angeles Solved a Problem Where a Company Spent More Than 18 Hours Per Week Collecting Machine Performance Logs Manually Using n8n

Collecting machine performance logs manually can be a time-consuming and error-prone task, especially when it consumes over 18 hours per week, diluting a company’s focus and operational efficiency.🚀 This was precisely the challenge faced by a manufacturing company based in Los Angeles, where production data accuracy and timely reporting were critical to maintaining optimal machine uptime and production quality.

In this case study, we will walk you through how automation using n8n enabled this company to transform their manual workflow into a seamless, error-resistant process. You will learn about the client’s initial challenges, the approach taken by RestFlow, the detailed automation architecture and workflow, and the remarkable results achieved. Also included are hands-on insights, technical details, and practical examples on integrating tools like Google Sheets, Slack, and machine APIs with n8n.

Whether you are a CTO, an automation engineer, or an operations specialist, this article provides practical guidance for automating complex data collection tasks to reduce workload, improve accuracy, and enhance reporting efficiency.

The Problem: Time-Consuming Manual Machine Log Collection in Los Angeles

The client is a mid-sized manufacturing company headquartered in Los Angeles, USA, specializing in precision parts fabrication. Their production operations relied heavily on continuous monitoring of multiple machines’ performance logs to ensure smooth operations and proactive maintenance.

Up until the automation project, the operations team spent over 18 hours weekly manually collecting these logs from various machine interfaces and APIs, consolidating them into spreadsheets for auditing and performance tracking. This tedious process was labor-intensive and prone to human error, resulting in inaccurate logs and delayed insights.

Specific pain points included:

• Time Wastage: Manual extraction and collation took approximately 18-20 hours per week.
• Error Rate: Errors in transcription and data duplication caused inaccurate reports in about 15% of the datasets.
• Delayed Reporting: Data insights were often delayed by 1-2 days, slowing decision-making and preventive maintenance actions.
• Lack of Real-Time Visibility: No live dashboards meant reactive, not proactive, handling of machine issues.

These issues not only impacted operational efficiency but also posed risks to equipment uptime and product quality, ultimately affecting customer satisfaction and company profitability.

Our Approach: Discovery and Automation Proposal by RestFlow

RestFlow’s automation architects began by performing a thorough discovery phase, engaging with the client’s Operations and IT departments to map the existing workflow end-to-end. We documented:

• Sources of machine performance logs (machine APIs, FTP servers, on-premise database extracts).
• Current manual data collection and validation steps.
• Reporting and auditing requirements and tools (Google Sheets, Slack alerts, PDF reports).
• Pain points and bottlenecks impacting speed and accuracy.

The main goal was to design an automated workflow that:

• Periodically fetches machine performance logs from multiple sources.
• Validates and consolidates data automatically.
• Updates centralized Google Sheets dashboards and sends Slack notifications for anomalies.
• Maintains logs for auditing and future analysis.

The choice of automation platform was critical. After evaluating options like Make and Zapier, we selected n8n for its open-source flexibility, powerful integration capabilities with APIs, and cost-effectiveness for large datasets.

Our high-level architecture proposed:

• Scheduled triggers in n8n to initiate data collection.
• API calls and FTP downloads integrated via HTTP request and FTP nodes.
• Google Sheets nodes for data consolidation and reporting.
• Slack nodes for alerting operational teams about data anomalies or process failures.

This approach promised a fully automated, monitored, and scalable workflow with minimal human involvement.

The Solution: Architecture & Workflow

Global Automation Architecture Overview

The automation solution was architected to run on a hosted n8n instance managed by RestFlow, providing Automation-as-a-Service with continuous monitoring and maintenance.

The key components included:

• Trigger: A scheduled n8n workflow that runs every hour during working days, ensuring near real-time data freshness.
• Data Sources: Machine performance logs were collected from RESTful machine APIs, FTP servers containing batch log files, and legacy SQL database extracts (via API gateway).
• Automation Orchestrator: n8n orchestrated the entire process leveraging HTTP Request nodes, FTP nodes, and Google Sheets nodes.
• Processing & Validation: Data transformations in n8n included JSON parsing, schema validation, and conditional branching to filter out invalid or duplicate records.
• Output Destinations: Updated Google Sheets dashboards provided visibility; Slack notifications alerted operators to anomalies; Log files were stored in cloud storage for audit traceability.

End-to-End Workflow Walkthrough

1. Scheduled Trigger: The workflow begins with an n8n Cron node set to run every hour from 8 AM to 6 PM, Monday to Friday.
2. Fetch Machine Logs via API: HTTP Request nodes call each machine’s REST API endpoint, using OAuth2 token authentication stored securely as n8n credentials.
3. Download FTP Batch Files: FTP nodes retrieve daily batch log files from the machines’ FTP server. Files are parsed using n8n’s JSON and text processing nodes.
4. Fetch Legacy Data: Additional data is fetched from the client’s SQL database API endpoint, which returns JSON arrays of performance metrics.
5. Data Aggregation & Validation: Custom JavaScript Function nodes unify data formats, check for missing fields or corrupted entries, and remove duplicates based on machine ID and timestamp.
6. Error Detection: Conditional nodes examine data fields for anomalies, such as unexpected spikes or missing logs, triggering Slack alerts if thresholds are breached.
7. Update Google Sheets: Validated records are appended to the client’s master performance logs spreadsheet using Google Sheets nodes with batch update capabilities.
8. Notification Dispatch: Slack nodes send summary reports and anomaly alerts to the Operations Slack channel for immediate action.
9. Logging: All workflow executions, errors, and exceptions are logged in a dedicated audit Google Sheet and centralized log files stored on cloud storage.

Step-by-Step Node Breakdown 🔧

1. Scheduled Trigger Node

Node Type: Cron Trigger
Role: Starts the workflow every hour on weekdays.
Configuration: Runs at minute 0 of each hour, 8 AM to 6 PM Monday to Friday.
Example: Expression used: cron expression “0 8-18 * * 1-5”.

2. Fetch Machine Logs via HTTP Request 📡

Node Type: HTTP Request
Role: Calls machine APIs using GET requests.
Key Fields: URL endpoints vary per machine, OAuth2 Token stored in n8n Credentials.
Example: Request headers include Authorization: Bearer token. Response JSON processed in next node.

3. FTP Download Node

Node Type: FTP
Role: Downloads batch log files.
Key Config: FTP server URL, login credentials stored securely.
Processing: Files parsed with n8n’s Function nodes to extract JSON lines.

4. Data Aggregation & Validation Function Node 🛠️

Node Type: Function
Role: Merges API and FTP data, removes duplicates.
Logic: Filters out records with missing timestamp or machine ID. Deduplication based on JSON path expressions comparing existing IDs.
Sample Expression: Items.filter(item => item.timestamp && item.machineId).

5. Conditional Node for Anomaly Detection

Node Type: IF Node
Role: Checks for out-of-threshold values.
Example: Conditions like: if performanceMetric > 95% threshold.
Outcome: Routes data to Slack alert node or continues to update.

6. Google Sheets Update Node 📊

Node Type: Google Sheets
Role: Appends new validated records.
Key Fields: Spreadsheet ID, worksheet name, mapped columns for machine ID, timestamp, metrics.
Optimization: Batch append to reduce API calls, concurrency set to 3.

7. Slack Notification Node

Node Type: Slack
Role: Sends notifications to Operations channel.
Message: Includes summary statistics and anomaly alerts.
Config: Slack webhook URL stored securely.

8. Audit Logging Node

Node Type: Google Sheets or File Storage
Role: Logs run status, errors, and processing counts for traceability.

Error Handling, Robustness & Security

Error Handling & Retries

The workflow employs n8n’s built-in error handling with retry attempts configured for HTTP and FTP nodes (3 retries with exponential backoff). Failures trigger alerts via Slack to the DevOps team. Non-critical errors are logged for later review without halting the entire workflow.

Logging and Monitoring

All execution logs, error messages, and summary statistics are recorded to dedicated Google Sheets audit logs and backed up on cloud storage. RestFlow’s monitoring dashboards offer real-time status updates and error rates to ensure operational awareness.

Security & Data Protection 🔒

API tokens, OAuth credentials, and sensitive login details are stored securely within n8n’s credential manager with role-based access control. Data exchanged uses HTTPS endpoints to secure transmission. Personally Identifiable Information (PII) is not involved in logs, but if included, is masked or encrypted where necessary.

Performance, Scaling & Extensibility

The architecture supports scaling by using batching and concurrency controls on Google Sheets updates and parallel HTTP requests. Webhook triggers were considered but scheduled polling worked better due to machine API constraints.

The workflow can be extended to:

• Support new machine types via modular nodes.
• Integrate additional notification channels like email or SMS.
• Adapt to new clients or locations by changing token configurations and endpoints.

RestFlow’s hosted environment supports safe versioning with staging and production workflows, minimizing downtime during updates.

Comparison Table 1: n8n vs Make vs Zapier for This Use Case

Option	Cost	Pros	Cons
n8n	Open-source (Self-hosted: Free; Managed by RestFlow starts at $49/mo)	Highly customizable; supports complex workflows; good for REST API & FTP; transparent licensing	Requires hosting; steeper learning curve than Zapier
Make	From $9/mo for basic plans; higher plans required for heavy use	Visual builder; good prebuilt integrations; easy for business users	Limited customization; expensive for high volume; less control over workflow logic
Zapier	Free limited; paid plans from $19.99/mo	Easy to use; vast app ecosystem; good for simple tasks	Limited API customization; slower for large datasets; costly at scale

Comparison Table 2: Webhooks vs Polling for Data Fetching

Method	Latency	Complexity	Reliability
Webhooks	Near real-time	Requires endpoint for receiving data; more setup	Good if source supports it; dependent on source uptime
Polling (Scheduled)	Delayed (interval dependent)	Simple to configure; platform manages schedule	More reliable for non-webhook APIs; can cause redundant requests

Comparison Table 3: Google Sheets vs Database for Log Storage

Storage Type	Cost	Pros	Cons
Google Sheets	Free up to limits; part of Google Workspace plans	Easy to view/edit; native integrations; user familiarity	Limited row capacity (~10k rows ideal); latency at scale; concurrency issues
Database (SQL/NoSQL)	Varies; Cloud DB costs apply	Handles large volumes; fast queries; supports complex analysis	Requires technical setup; less accessible for non-tech users

Looking to start automating data workflows like this? Explore the Automation Template Marketplace for ready-to-use examples and inspiration.

Results & Business Impact

Implementing this n8n automation workflow brought transformative benefits:

• Time Saved: Over 18 hours per week freed from manual data collection, translating to more productive focus on critical tasks.
• Error Reduction: Data errors decreased by 90%, substantially improving report accuracy and trustworthiness.
• Improved SLA: Reporting latency dropped from 1-2 days to under 1 hour, enabling proactive maintenance and faster response.
• Operational Visibility: Near real-time dashboards improved the Operations team’s situational awareness and responsiveness.

The automation not only reduced overhead but also enhanced the quality of insights, driving better decision-making and equipment uptime. User feedback highlighted the ease and reliability of the new process, significantly reducing stress and operational delays.

Operations engineers can now focus on analyzing trends rather than wrangling data, and the management team receives timely alerts for anomalies.

Pilot Phase & Ongoing Maintenance Disclaimer

RestFlow handled a careful pilot phase before full deployment, running the automated workflow alongside the manual process with limited machine sets. During this pilot, minor issues such as corner case anomalies and edge data formats were identified and resolved.

Post-pilot, RestFlow provides Automation-as-a-Service including hosting, monitoring, error alerting, updates, and continuous improvements to keep the workflow reliable and up to date.

This iterative approach ensures automation adapts to real-world conditions without disrupting client operations.

Conclusion: Transform Your Manual Data Processes with RestFlow Automation

This case study demonstrates how a Los Angeles manufacturing company successfully solved their manual machine performance log collection problem by leveraging n8n automation orchestrated by RestFlow. The transformation saved significant manual hours, reduced errors drastically, accelerated reporting, and empowered the operations team with real-time insights.

RestFlow’s comprehensive Automation-as-a-Service offering covers the entire lifecycle—from process discovery and custom workflow design to implementation, hosting, monitoring, and continuous maintenance—ensuring your automation runs smoothly at scale.

If you’re ready to upgrade your workflows and drive operational excellence, don’t wait to begin your automation journey. Explore the Automation Template Marketplace for prebuilt workflows or Create Your Free RestFlow Account today and see how easy it is to get started.