We are firmly in the era of Artificial Intelligence. AI is reshaping how organisations research vendors, compare platforms, and generate early shortlists. Tools like ChatGPT, Perplexity, and Gemini can surface information faster than ever before.
But while AI has changed how information is accessed, it has not changed the core challenge leaders face:
Who can be trusted to guide us to the right vendor, the right partner, and the right delivery path?
AI can generate lists. But it cannot judge delivery risk, organisational readiness, or implementation reality.
That gap between information and judgment is where many enterprise programs fail.
A Summary of Real vs Artificial Intelligence
AI has changed how organisations research enterprise software, but it hasn’t changed what determines success. While AI tools can quickly generate vendor lists and surface market information, they fall short when it comes to the highest-risk phase: committing to a solution and making it work in practice. This article explains where AI-led software research breaks down, why experience-led judgment still matters, and how SMC’s Real Intelligence helps bridge the gap between information and outcomes.
Key Takeaways:
- AI is effective for early research, but it cannot replace judgment in high-stakes software decisions
- The greatest risks emerge when moving from options to commitment, not during initial shortlisting
- AI cannot assess delivery capability, organisational context, or implementation risk
- Real Intelligence combines experience, independence, and a structured process to reduce failure risk
- Successful selection extends beyond vendors to governance, partners, and delivery oversight
- Enterprise software delivers value only when decisions are grounded in context, accountability, and execution discipline
Comparing SMC Expertise with AI
| Aspect | SMC ‘Real Intelligence’ | Generic AI |
|---|---|---|
| Market Insight | Deep, localised, real-world expertise since 2006 selecting and implementing enterprise software (SMC’s unique IP) | Generic research, limited local nuance |
| Shortlist Creation | Holistic, stakeholder-driven and objectively validated using your specific knock-out criteria and SMC’s SelectionCoach software selection platform | Based on pattern recognition and global data |
| Due Diligence | Rigorous, context-rich, includes financials, demos, references, hidden risks | Limited to public info, excludes nuanced factors like vendor-controlled data |
| Implementation Success | Support throughout implementation for maximum ROI and minimal disruption | No practical support beyond shortlist creation and good practice concepts |
| Independence | 100% vendor-independent, unbiased, client-side advocacy | Potential biases (e.g. favouring certain vendors) |
Where AI-Driven Selection Falls Short
AI tools such as ChatGPT, Perplexity, and Gemini are increasingly used to scan the market, summarise public information, and generate initial software shortlists.
However, they stop well short of what enterprise decision-making actually requires.
What AI still cannot do reliably in this context is:
- Assess vendor delivery track records
- Anticipate implementation risks
- Interpret the realities of operating in specific industries or organisational contexts
- Conduct reference checks
- Negotiate commercial terms
- Stay accountable once a contract is signed
AI-generated outputs are also limited by the quality and scope of public information. They can reflect bias, outdated assumptions, or generic positioning that overlooks Australian awards, enterprise agreements, payroll obligations, and sector-specific compliance requirements. Fair Work makes clear that employees may be covered by awards or enterprise agreements, and those conditions materially affect software fit.
These limitations matter most at the point where risk is highest: moving from options to commitment.
Why Experienced Judgment Still Matters
Selecting an ERP or enterprise platform based mainly on AI-generated recommendations is a shortcut that can increase the risk of misalignment, scope creep, and delivery failure.
SMC’s Real Intelligence closes the gap between information and judgment.
It combines independent, experience-led advice with a structured, evidence-based approach to software selection and software implementation. Clients are supported in moving from a broad, informed view of the market to a rigorously vetted preferred solution: one that aligns with their operating model, risk appetite, and long-term objectives.
Crucially, that support does not stop at selection. Real Intelligence extends to governance, partner management, and implementation oversight to ensure promised value is realised in practice, not just on paper.
Where Independent AI Advisory Adds Real Value
AI has changed how organisations access information, but it hasn’t removed the need for judgment. In fact, as AI-driven tools accelerate early-stage research and shortlisting, the risk has shifted downstream to the point where decisions are locked in, and accountability begins.
This is where independent AI advisory adds the most value.
In our experience, the biggest failures don’t occur because organisations lack options. They occur because assumptions went untested, data readiness was overestimated, or implementation and governance risks weren’t surfaced early enough. AI tools are not designed to diagnose these issues. They work with what is visible, not what is operationally true.
Effective AI consulting focuses on helping leaders answer the harder questions before committing to platforms, partners, or programs, including:
- Whether the underlying data quality, integration, and governance are strong enough to support AI-enabled outcomes
- Which use cases are realistic given the organisation’s operating model, risk profile, and capability maturity
- How AI initiatives interact with existing ERP, HR, finance, and operational systems
- Where human oversight, control frameworks, and accountability must sit
- How success will be measured beyond pilot activity or feature adoption
Rather than pushing organisations to adopt AI faster, independent AI consulting brings discipline to where and how AI should be applied. It helps leaders separate experimentation from execution, and opportunity from obligation.
When AI is treated as part of a broader transformation landscape, alongside data, systems, people, and governance, it becomes a source of advantage rather than an added source of complexity. That’s the difference between using AI as a shortcut and using it as a capability that delivers defensible, measurable outcomes.
Frequently Asked Questions About AI-Led Software Selection
AI tools are useful for scanning public information, summarising vendor positioning, and generating broad comparison lists. They can accelerate early exploration and help organisations understand the options available in the market.
AI cannot validate requirements, assess vendor or partner delivery capability, interpret internal organisational context, or evaluate implementation risk. These are the factors that most strongly influence outcomes.
Results depend on the model, the prompt, and the data sources used. Gaps in information or outdated content can lead to inconsistent, incomplete, or misleading shortlists.
Not entirely. AI lacks access to verified delivery performance, partner capacity, regional constraints, or contractual outcomes. Rankings are often generated without supporting evidence.
Only at a high level, and not with the consistency required for high-stakes software decisions. In Australia, awards, enterprise agreements, payroll obligations, and state or sector-specific requirements can materially change what ‘fit’ looks like. AI tools can reference general standards, but they do not consistently account for Australian legislation, sector-specific obligations, EBAs, or state-based requirements.
No. AI cannot assess legacy issues, internal dynamics, political constraints, or why previous programs succeeded or failed, all of which materially affect transformation outcomes.
Use AI to gather information, frame questions, and accelerate discovery. Use experienced advisors to validate insights, apply context, assess risk, and guide final decisions.
- Selecting solutions that don’t fit the operating model
- Choosing partners who cannot deliver
- Underestimating integration and change complexity
- Failing to realise expected benefits
Because they rely on pattern recognition rather than verified data. This can result in mixed product lines, merged vendor profiles, outdated references, or incorrect assumptions.
Independent comparisons, solution overviews, and shortlist resources can help organisations narrow the market before deeper evaluation begins.
About the Author
Jamon Johnston
Jamon Johnston is CEO and Founder of SMC, with more than 30 years of experience advising mid-sized and enterprise organisations on enterprise software and digital transformation. After senior leadership roles at Andersen and Deloitte, he founded SMC in 2006 to provide truly independent, client-side advisory across Australia and New Zealand. Jamon specialises in helping organisations make confident technology decisions, reduce risk, and deliver successful large-scale transformation programs. He is known for his deep market insight, practical approach, and ability to bring clarity and confidence to complex change initiatives.
Make the Right Call With Real Intelligence From SMC
Enterprise software investments succeed when decisions are grounded in context, experience, and accountability.
Organisations that work with SMC benefit from advisors who understand the Australian market, speak the language of executives and delivery teams, and remain engaged from strategy through to implementation success.
With more than 750 enterprise transformation projects delivered since 2006, SMC brings proven methodology, independent governance, and deep local insight to every engagement, helping ensure technology decisions translate into measurable business outcomes. If the decision carries material commercial or delivery risk, AI can help you gather information, but experienced judgment is what protects the outcome.
Get more insights from Solution Minds Consulting in Google Search.