Itential logo
2026 Infrastructure & Network Automation Tools Landscape

Research, Methodology & Glossary of Terms

This document explains the research methodology and processes used to create the Automation Tools Research Overview and its associated analysis pages. The goal was to build a comprehensive, research-backed guide to help enterprise leaders make informed decisions about network and infrastructure automation tools.

Research Methodology

Core Research Principles

Evidence-Based Analysis

All claims and findings in this research are supported by authoritative sources including:

  • Industry surveys and research reports (EMA, Network World, NetBox Labs)
  • Academic studies (peer-reviewed research on automation challenges)
  • Economic analysis (IDC total cost of ownership studies)
  • Real-world implementation case studies
  • Technical documentation and community feedback
  • Commercial tool evaluations

Citation Standards

  • All statistics, claims, and findings include proper APA-style citations
  • Sources are linked for verification and further research
  • Multiple sources validate critical findings
  • Methodology limitations are transparently documented

Objectivity & Balance

  • Present both strengths and limitations of each tool category
  • Avoid vendor bias in favor of fact-based comparison
  • Acknowledge trade-offs rather than promoting single solutions
  • Include “where they shine” and “where they lack” for every category

Research Process

Phase 1: Industry Research & Data Collection

Objective: Understand the current state of automation adoption, success rates, and common challenges.

Sources:

  • McGillicuddy (2025): Network automation success rates (18% full success, 54% partial, 28% fail)
  • Beevers/NetBox Labs (2024): Funding correlation analysis (80% success with full funding vs 29% underfunded)
  • Itential & EMA (2024): Top challenges facing automation initiatives
  • Axians UK (2023): Public sector adoption statistics (95% manual changes)

Output: Executive Summary with key statistics establishing the “automation gap” problem

Phase 2: Tool Category Analysis

Objective: Map the automation tool landscape into logical categories that help organizations understand positioning.

Categories Established:

  1. Configuration Management Tools (Ansible, SaltStack, Chef)
  2. Infrastructure as Code Platforms (Terraform, Pulumi, CloudFormation)
  3. Network Source of Truth Platforms (NetBox, Nautobot, Infrahub)
  4. Vendor-Native Management Platforms (Catalyst Center, CloudVision, Mist, Central)
  5. Multi-Vendor Orchestration Platforms (Itential, NSO, ServiceNow)

Research Approach for Each Category:

  • Technical documentation review: Official docs, release notes, capability matrices
  • Community feedback analysis: User forums, GitHub issues, Reddit discussions, conference talks
  • Case study analysis: Published implementation stories, vendor-provided use cases
  • Hands-on evaluation: Where possible, testing tool capabilities and limitations

Structured Analysis Framework:

  • Sample tools: Representative products in the category
  • Where they shine: Ideal use cases and strengths
  • Where they lack: Known limitations and failure modes
  • Key finding: Research-backed insight with citation
  • Call to action: Link to detailed analysis page

Phase 3: Economic Analysis

Objective: Expose the hidden costs that doom 82% of automation projects.

Two critical economic analyses were conducted:

Commercial vs. Open Source Economics

  • IDC research citation: $2.08M annual benefit advantage for commercial solutions
  • Hidden cost quantification: 15-25% of engineering time on open-source maintenance
  • Compliance risk analysis: 85% of codebases have license compliance issues
  • 3-year TCO comparison: Open source often costs 15-20% more than commercial

Custom Development vs. Commercial Tools

  • The 70% rule: 70% of custom script lifecycle is maintenance, not development
  • Maintenance burden: 20-25% of initial dev cost annually to keep scripts current
  • Resource allocation: 30-50% of engineering capacity on script maintenance
  • Knowledge transfer crisis: 20-30% of custom projects become “untouchable legacy code”
  • Long-term economics: Custom development typically costs 300-500% more over 3 years

Research Sources: CEO Hangout (2025), Phoenix DX (2024), Quality Logic (2023), Woodward (2010), Network Operations Research, IT Convergence, GitOps Adoption Survey

Phase 4: Tool Selection Framework Development

Objective: Provide quantitative evaluation framework to replace subjective tool decisions.

Framework Components:

  • Four-dimension scoring system with weighted criteria
  • Team fit: Skills, experience, organizational maturity
  • Environment complexity: Scale, vendor diversity, regulatory requirements
  • Business needs: Use cases, integration requirements, service delivery timelines
  • Implementation risk: Time-to-value, change management, support requirements

Comparative Analysis:

  • Scoring matrices for different organization profiles
  • Real-world scenario walkthroughs
  • Objection-handling decision trees

Phase 5: Vendor & Product Deep Dives

Each major tool or platform receives detailed analysis following a consistent structure.

Standard Analysis Template:

  • Overview: What the tool is and its primary purpose
  • Core capabilities: Key features and functionality
  • Strengths: Where it excels with research backing
  • Limitations: Known gaps with specific examples
  • Economic analysis: Licensing costs, implementation effort, TCO
  • Use case fit: When to choose this tool vs. alternatives
  • Integration considerations: How it works with other tools

Research Methods:

  • Official vendor documentation and pricing
  • Third-party reviews and analyst reports
  • Community feedback and user experiences
  • Technical testing where applicable
  • Competitive positioning analysis

Phase 6: Content Structure & Navigation

Information Architecture:

  • Hub page: “Automation Tools Research Overview” serves as the entry point
  • Category pages: Each tool category has dedicated analysis page
  • Economic analysis pages: Separate deep dives on cost considerations
  • Framework page: Tool selection methodology
  • Glossary & methodology: This page documenting the process

User Journey Design:

  • Executive summary for quick understanding
  • Progressive disclosure: high-level → detailed analysis
  • Clear CTAs linking to relevant deep-dive pages
  • Internal cross-linking between related topics

Quality Control & Validation

Accuracy Verification

  • Multi-source validation: Critical statistics verified across multiple sources
  • Vendor documentation checks: Technical claims validated against official docs
  • Peer review: Content reviewed for technical accuracy and clarity
  • Update tracking: Version messages in Confluence documenting all changes

Limitations & Transparency

  • Acknowledged gaps: Areas where definitive data is unavailable
  • Methodology notes: Assumptions and estimation methods documented
  • Date sensitivity: Recognition that tool capabilities evolve rapidly
  • Organizational variability: Recognition that results vary by context

Continuous Improvement

  • New research integration: Process for incorporating emerging studies
  • User feedback: Mechanism for capturing questions and confusion points
  • Content refresh: Regular review cycle to keep statistics current

Writing & Presentation Standards

Tone & Style

  • Research-backed but accessible: Blend data with readable prose
  • Balanced perspective: Present trade-offs, not marketing claims
  • Action-oriented: Help readers make decisions, not just understand concepts
  • Executive-friendly: Lead with key findings, support with detail

Formatting Consistency

  • Bold for key statistics: Makes scanning easier
  • Italics for emphasis: Used sparingly for critical insights
  • Structured headings: Consistent hierarchy across all pages
  • Call-to-action links: Guide readers to next steps

Visual Aids

  • Spectrum diagram: Tool positioning from low-code to enterprise orchestration
  • Comparison matrices: Side-by-side tool evaluation
  • Decision trees: Framework for tool selection
  • Case study summaries: Real-world application examples

Glossary of Terms

Automation Categories

Term Definition
Configuration Management (CM) Automation approach using declarative models (typically YAML) to define and enforce desired system configurations. Tools like Ansible, SaltStack, and Chef apply playbooks or recipes to ensure devices match specified states. Primary use: Repeatable configuration tasks across infrastructure.
Infrastructure as Code (IaC) Practice of managing infrastructure through machine-readable definition files rather than manual configuration. Tools like Terraform and Pulumi provision cloud resources, networks, and services using declarative code with state management. Enables version control, repeatability, and automation of infrastructure changes.
Network Source of Truth (SoT) Authoritative database storing intended network design, device inventory, IP addressing, and relationships. Serves as the “single source of truth” feeding automation workflows with accurate desired state. Examples: NetBox, Nautobot, Infrahub. Critical for preventing configuration drift and enabling automated compliance.
Orchestration Coordination of automated tasks across multiple domains, systems, and tools to achieve complex business outcomes. Unlike simple automation (single tasks), orchestration manages workflows spanning vendor boundaries, approval processes, rollback procedures, and cross-team coordination. Essential in heterogeneous enterprise environments.
Vendor-Native Platform Management system built by hardware vendor specifically for their equipment ecosystem. Offers deep integration with vendor-specific features but limited multi-vendor capability. Examples: Cisco Catalyst Center, Arista CloudVision, Juniper Mist.
Multi-Vendor Platform System designed to coordinate automation across different vendors’ equipment and management platforms. Addresses the reality that 87% of enterprise networks use multiple vendors. Examples: Itential, Cisco NSO, ServiceNow + Network Automation.

Automation Concepts

Term Definition
Day-0 Automation Initial device provisioning and deployment automation. Includes: zero-touch provisioning, initial configuration templates, network service design. Represents approximately 20-30% of network lifecycle work.
Day-1 Automation Service activation and initial configuration after deployment. Includes: policy application, service instantiation, initial integration with management systems.
Day-2 Automation Ongoing operational activities representing 70-80% of network lifecycle. Includes: configuration changes, troubleshooting, optimization, upgrades, compliance validation. Most automation tools struggle with Day-2 complexity.
Declarative Automation Approach where you specify desired end state (“what”) rather than procedural steps (“how”). System determines how to achieve that state. Contrasts with imperative/procedural automation. Examples: Terraform HCL, Ansible playbooks.
Idempotency Property where running the same automation multiple times produces identical results without unintended side effects. Critical for reliable automation—rerunning a playbook shouldn’t cause problems.
State Management Tracking and maintaining record of actual vs. desired infrastructure configuration. IaC tools use state files to detect drift and determine necessary changes. State file corruption is a common failure mode.

Economic Terms

Term Definition
Total Cost of Ownership (TCO) Comprehensive cost analysis including: licensing, infrastructure, labor (development, maintenance, operations), training, support, and opportunity costs over multi-year period (typically 3-5 years).
The 70% Rule Research finding that 70% of custom automation script lifecycle is spent on maintenance, not initial development. Drives the economic disadvantage of custom development vs. commercial tools (300-500% higher TCO over 3 years).
Hidden Costs Expenses not captured in initial tool selection but critical to TCO. Open source: Maintenance overhead (15-25% engineering time), license compliance review, lack of support SLAs. Custom development: Maintenance burden, knowledge transfer risk, technical debt accumulation. “Free” tools are often most expensive when labor costs are included.
Technical Debt Accumulated cost of suboptimal implementation choices, unmaintained code, security vulnerabilities, and integration brittleness. Grows over time if not actively managed. Particularly severe in custom automation scripts (20-30% become unmaintainable when developers leave).
Opportunity Cost Value of alternative uses for engineering resources. Example: Engineers maintaining custom scripts can’t work on strategic initiatives. Critical factor in build vs. buy decisions—maintaining automation vs. delivering business value.

Success Metrics

Term Definition
Automation Success Rate Research-established benchmarks: 18% projects achieving full success (McGillicuddy, 2025). 54% achieving partial results. 28% that stall or fail outright. 80% vs 29% success rate for fully funded vs. underfunded projects (Beevers, 2024).
Complexity Wall Point at which tool or approach breaks down under scale/complexity. Example: Ansible reliability issues reported by 32.1% of users, with predictable complexity wall around 250 devices requiring either Red Hat AAP+ ($650K-$3.45M TCO) or platform shift.
Day-2 Operations Gap The reality that infrastructure provisioning (IaC’s strength) represents only 20-30% of network service delivery. The remaining 70-80% requires operational workflows and business logic that IaC tools weren’t designed to handle.
Documentation Accuracy Research finding: Network documentation maintains only 15-30% accuracy without automated synchronization. Manual data entry consumes 15-25% of engineering time. 60% of documentation projects fail due to maintenance burden.

Technical Terms

Term Definition
API (Application Programming Interface) Programmatic interface for interacting with systems. Network automation relies on vendor APIs (NETCONF, RESTCONF, REST APIs) to configure devices. API quality and coverage vary significantly across vendors—critical evaluation criterion.
Playbook In Ansible context: YAML file defining automation tasks, their sequence, and target systems. Contains plays (groupings of tasks) executed against inventory hosts. Can range from simple (10-20 lines) to complex (thousands of lines).
Module Pre-built automation component for specific task or system. Ansible has thousands of modules (network device config, cloud provisioning, etc.). Module quality varies—vendor-supported modules are higher quality than community contributions.
Provider In Terraform context: Plugin enabling infrastructure provisioning for specific platform (AWS, Azure, network vendors). 3,000+ providers available but quality varies wildly. Cloud providers excellent; network device providers inconsistent.
State Drift Divergence between actual infrastructure configuration and documented/intended state. Occurs through: manual changes, emergency fixes, undocumented modifications. Detection and remediation require automation and source-of-truth integration.
CI/CD (Continuous Integration / Continuous Deployment) Software development practice of automating code integration, testing, and deployment. Infrastructure teams adapt CI/CD for network automation—commit config changes to Git, automated testing, automated deployment pipeline.

Organizational Terms

Term Definition
Automation Maturity Organization’s capability level for automation. Level 1: Ad-hoc scripting. Level 2: Some automation, inconsistent. Level 3: Standardized automation, source control, testing. Level 4: Orchestration, self-service, integration. Level 5: Autonomous operations, ML-driven. Tool selection must match maturity level.
Citizen Automator Non-developer staff member using low-code/no-code tools to automate their own workflows. Tools: Zapier, Make, n8n. Effective for departmental productivity but dangerous for business-critical infrastructure without governance.
Center of Excellence (CoE) Centralized team providing automation expertise, standards, tool governance, and best practices to organization. Critical for automation success at scale—prevents tool sprawl and maintains standards.
Funding Correlation Research finding: Investment level is single biggest predictor of automation success. 80% of fully funded projects succeed vs. 29% of underfunded projects. “Free” tools often fail because organizations underestimate labor requirements.

How to Use This Research

Use Case Recommended Approach
Tool Evaluation Start with Tool Selection Framework to quantify your requirements, then reference specific tool category pages for detailed analysis.
Business Case Development Use economic analysis pages (Commercial vs. Open Source, Custom vs. Commercial) to build TCO models and justify investment.
Executive Communication Lead with statistics from Executive Summary (18% success rate, funding correlation) to set realistic expectations.
Vendor Discussions Reference specific findings and citations when evaluating vendor claims—all research is backed by authoritative sources.
Continuous Learning Check references section for links to original research reports and studies for deeper investigation.

Dive Deeper into Network & Infrastructure Automation & Orchestration

Get Started

Agentic infrastructure operations starts here.

See how Itential connects AI reasoning to governed execution across your entire infrastructure.

Talk to our Experts