As companies increasingly adopt artificial intelligence (AI), rising token consumption is leading clients of India's major technology services firms to reassess their AI deployment strategies. Tata Consultancy Services Ltd, HCL Technologies Ltd, and Wipro Ltd reported during their latest earnings calls that clients are adjusting their AI model usage to manage escalating costs associated with token consumption.
Key Details
Tokens are the fundamental units of data that AI models, such as OpenAI's ChatGPT, utilize for processing language. The more a company utilizes an AI model, the more tokens it consumes, resulting in higher expenses. Phil Fersht, chief executive of HFS Research, noted,
The unit cost is becoming cheaper while total AI consumption is growing exponentially, so enterprise AI bills are increasing even as the underlying technology becomes more efficient.
Background
This cost concern has surfaced as enterprises tighten technology budgets amid rising AI expenses and geopolitical uncertainties. C Vijayakumar, chief executive of HCLTech, remarked that discussions around token costs have become prevalent as companies scale their AI adoption. He stated,
If you see about 3 months ago or 6 months ago, token cost was not a topic. It's only when enterprises started scaling the adoption of AI, the whole various dimensions of token costs came into play.
HCLTech is implementing a tiered structure for its AI solutions, offering both small and large models based on client needs, reflecting a broader trend in the IT services sector regarding AI offerings.
Rising AI token costs could lead to increased expenses for technology firms and their clients, particularly in the IT services sector, as companies seek to balance AI adoption with budget constraints. Investors will watch for how these firms adjust their pricing strategies and service offerings in response to changing client needs.